Sep 29 18:09:19 devstack cinder-volume[75890]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 29 18:09:19 devstack cinder-volume[75890]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 18:09:19 devstack cinder-volume[75890]: we strongly recommend against using it for new projects.
Sep 29 18:09:19 devstack cinder-volume[75890]: If you are already using Eventlet, we recommend migrating to a different
Sep 29 18:09:19 devstack cinder-volume[75890]: framework.  For more detail see
Sep 29 18:09:19 devstack cinder-volume[75890]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 18:09:19 devstack cinder-volume[75890]:   import eventlet  # noqa
Sep 29 18:09:22 devstack cinder-volume[75890]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75890) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 18:09:22 devstack cinder-volume[75890]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75890) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 18:09:22 devstack cinder-volume[75890]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75890) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 18:09:23 devstack cinder-volume[75890]: INFO dbcounter [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Registered counter for database cinder
Sep 29 18:09:23 devstack cinder-volume[75890]: DEBUG oslo_db.sqlalchemy.engines [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75890) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:09:23 devstack cinder-volume[75890]: DEBUG dbcounter [-] [75890] Writer thread running {{(pid=75890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 18:09:23 devstack cinder-volume[75890]: INFO cinder.rpc [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 29 18:09:23 devstack cinder-volume[75890]: INFO cinder.rpc [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 29 18:09:23 devstack cinder-volume[75890]: DEBUG oslo_db.sqlalchemy.engines [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75890) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:09:24 devstack cinder-volume[75890]: INFO cinder.volume.manager [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Determined volume DB was empty at startup.
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG cinder.volume.manager [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75890) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 29 18:09:24 devstack cinder-volume[75890]: INFO cinder.volume.manager [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 29 18:09:24 devstack cinder-volume[75890]: WARNING stevedore.named [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 18:09:24 devstack cinder-volume[75890]: WARNING castellan.key_manager [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 18:09:24 devstack cinder-volume[75890]: WARNING cinder.keymgr.conf_key_mgr [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG cinder.volume.drivers.lvm [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75890) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_concurrency.processutils [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_concurrency.processutils [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] CMD "cinder-rtstool verify" returned: 0 in 0.499s {{(pid=75890) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_db.sqlalchemy.engines [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75890) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:09:24 devstack cinder-volume[75890]: INFO cinder.rpc [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 29 18:09:24 devstack cinder-volume[75890]: INFO cinder.rpc [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 29 18:09:24 devstack cinder-volume[75890]: WARNING stevedore.named [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 18:09:24 devstack cinder-volume[75890]: WARNING castellan.key_manager [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 18:09:24 devstack cinder-volume[75890]: INFO cinder.volume.manager [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_db.sqlalchemy.engines [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75890) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:09:24 devstack cinder-volume[75890]: INFO oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Starting 1 workers
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Started child 76041 {{(pid=75890) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Full set of CONF: {{(pid=75890) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] ******************************************************************************** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Configuration options gathered from: {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] ================================================================================ {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 29 18:09:24 devstack cinder-volume[76041]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] allow_availability_zone_fallback = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] allow_compression_on_image_upload = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] allowed_direct_url_schemes     = [] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] api_rate_limit                 = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] auth_strategy                  = keystone {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] az_cache_duration              = 3600 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_availability_zone      = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_host                   = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_name                   = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_stats_polling_interval = 60 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backup_api_class               = cinder.backup.api.API {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backup_name_template           = backup-%s {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backup_use_same_host           = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backup_use_temp_snapshot       = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] chap_password                  = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] chap_username                  =  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cinder_internal_tenant_project_id = 6a572c5ac5e348eea6e83501d74e788f {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cinder_internal_tenant_user_id = 17c062f3adb34747a59d5a887c003800 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cloned_volume_same_az          = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cluster                        = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] compression_format             = gzip {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] config_dir                     = [] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] config_source                  = [] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] control_exchange               = openstack {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] debug                          = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] default_availability_zone      = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] default_group_type             = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] default_volume_type            = lvmdriver-1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] disk_geometry                  = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] driver_client_cert             = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] driver_client_cert_key         = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] driver_data_namespace          = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] driver_ssl_cert_path           = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] driver_ssl_cert_verify         = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] driver_use_ssl                 = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] enable_force_upload            = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] enable_new_services            = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] enable_unsupported_driver      = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] enforce_multipath_for_image_xfer = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] filter_function                = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance_api_insecure            = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance_api_servers             = ['http://192.168.122.251/image'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance_api_ssl_compression     = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance_ca_certificates_file    = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance_certfile                = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance_keyfile                 = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance_num_retries             = 3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance_request_timeout         = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] goodness_function              = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] graceful_shutdown_timeout      = 5 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] group_api_class                = cinder.group.api.API {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] host                           = devstack {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_compress_on_upload       = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_conversion_address_space_limit = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_conversion_cpu_limit     = 60 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_conversion_disable       = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_introspection_address_space_limit = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_introspection_cpu_limit  = 60 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_upload_use_cinder_backend = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_upload_use_internal_tenant = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_volume_cache_enabled     = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_volume_cache_max_count   = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] image_volume_cache_max_size_gb = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] init_host_max_objects_retrieval = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] iscsi_target_flags             =  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] iscsi_write_cache              = on {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] iser_helper                    = tgtadm {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] iser_ip_address                = 192.168.122.251 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] iser_port                      = 3260 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] log_color                      = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] log_config_append              = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] log_dir                        = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] log_file                       = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] log_options                    = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] log_rotate_interval            = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] log_rotate_interval_type       = days {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] log_rotation_type              = none {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] max_age                        = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] max_logfile_count              = 30 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] max_logfile_size_mb            = 200 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] max_over_subscription_ratio    = 20.0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] message_reap_interval          = 86400 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] message_ttl                    = 2592000 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] migration_create_volume_timeout_secs = 300 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] monkey_patch                   = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] monkey_patch_modules           = [] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] my_ip                          = 192.168.122.251 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] no_snapshot_gb_quota           = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] num_iser_scan_tries            = 3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] num_shell_tries                = 3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] num_volume_device_scan_tries   = 3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] nvmeof_conn_info_version       = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] nvmet_ns_id                    = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] nvmet_port_id                  = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] osapi_max_limit                = 1000 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] osapi_volume_ext_list          = [] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] osapi_volume_listen_port       = 8776 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] osapi_volume_use_ssl           = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] osapi_volume_workers           = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[76041]: INFO cinder.volume.manager [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] per_volume_size_limit          = -1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] periodic_fuzzy_delay           = 60 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] periodic_interval              = 60 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] public_endpoint                = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] publish_errors                 = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] quota_backup_gigabytes         = 1000 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] quota_backups                  = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] quota_gigabytes                = 1000 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] quota_groups                   = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] quota_snapshots                = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] quota_volumes                  = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] rate_limit_burst               = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] rate_limit_except_level        = CRITICAL {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] rate_limit_interval            = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] reinit_driver_count            = 3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] replication_device             = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] report_discard_supported       = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] report_interval                = 120 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] reservation_clean_interval     = 86400 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] reservation_expire             = 86400 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] reserved_image_namespaces      = [] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] reserved_percentage            = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] rpc_response_timeout           = 120 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] run_external_periodic_tasks    = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] scst_target_driver             = iscsi {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] scst_target_iqn_name           = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_down_time              = 720 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] shell_completion               = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] snapshot_name_template         = snapshot-%s {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] snapshot_same_host             = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] split_loggers                  = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] state_path                     = /opt/stack/data/cinder {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] storage_availability_zone      = nova {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] storage_protocol               = iSCSI {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] syslog_log_facility            = LOG_USER {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] target_helper                  = lioadm {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] target_ip_address              = 192.168.122.251 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] target_port                    = 3260 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] target_protocol                = iscsi {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] target_secondary_ip_addresses  = [] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] trace_flags                    = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] transport_url                  = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] until_refresh                  = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] use_chap_auth                  = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] use_default_quota_class        = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] use_journal                    = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] use_json                       = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] use_multipath_for_image_xfer   = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] use_stderr                     = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] use_syslog                     = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] verify_glance_signatures       = enabled {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_api_class               = cinder.volume.api.API {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_backend_name            = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_clear                   = zero {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_clear_ionice            = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_clear_size              = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_copy_bps_limit          = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_dd_blocksize            = 1M {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_name_template           = volume-%s {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_service_inithost_offload = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volume_usage_audit_period      = month {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] zoning_mode                    = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_concurrency.disable_process_locking = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.auth_section = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.auth_type   = password {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.auth_version = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.cache       = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:24 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.certfile    = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.include_service_catalog = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.insecure    = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.interface   = public {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.keyfile     = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_password = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcache_username = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.region_name = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.service_type = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.backend                  = dogpile.cache.null {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.backend_argument         = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.backend_expiration_time  = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.config_prefix            = cache.oslo {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.debug_cache_backend      = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.enable_retry_client      = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.enable_socket_keepalive  = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.enabled                  = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.expiration_time          = 600 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.hashclient_retry_attempts = 2 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.memcache_dead_retry      = 300 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.memcache_sasl_enabled    = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.password                 = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.proxies                  = [] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.redis_db                 = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.redis_server             = localhost:6379 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.retry_attempts           = 2 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.retry_delay              = 0.0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.socket_keepalive_count   = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.socket_keepalive_idle    = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.socket_keepalive_interval = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.socket_timeout           = 1.0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.tls_allowed_ciphers      = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.tls_cafile               = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.068s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.tls_certfile             = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.tls_enabled              = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.tls_keyfile              = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cache.username                 = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] coordination.backend_url       = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.asyncio_connection    = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.asyncio_slave_connection = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.backend               = sqlalchemy {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.connection            = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.connection_debug      = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.connection_parameters =  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.connection_recycle_time = 3600 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.connection_trace      = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.db_inc_retry_interval = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.db_max_retries        = 20 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.db_max_retry_interval = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.db_retry_interval     = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.max_overflow          = 50 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.max_pool_size         = 5 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.max_retries           = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.mysql_wsrep_sync_wait = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.pool_timeout          = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.retry_interval        = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.slave_connection      = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.sqlite_synchronous    = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.synchronous_reader    = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] database.use_db_reconnect      = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_tracing.insecure = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler.connection_string     = messaging:// {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler.enabled               = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler.es_doc_type           = notification {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler.es_scroll_size        = 10000 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler.es_scroll_time        = 2m {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler.filter_error_trace    = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler.hmac_keys             = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler.sentinel_service_name = mymaster {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler.socket_timeout        = 0.1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler.trace_requests        = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler.trace_sqlalchemy      = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler_jaeger.process_tags   = {} {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler_jaeger.service_name_prefix = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] profiler_otlp.service_name_prefix = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_policy.enforce_new_defaults = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_policy.policy_default_rule = default {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] privsep_osbrick.group          = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] privsep_osbrick.helper_command = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] privsep_osbrick.user           = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cinder_sys_admin.group         = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cinder_sys_admin.helper_command = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] cinder_sys_admin.user          = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.auth_section      = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.auth_type         = password {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.cafile            = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.certfile          = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.collect_timing    = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.insecure          = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.keyfile           = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.send_service_user_token = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.split_loggers     = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.timeout           = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.tls_ciphers       = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] service_user.tls_min_version   = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.auth_section            = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.auth_type               = password {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.certfile                = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.collect_timing          = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.insecure                = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.keyfile                 = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.region_name             = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.split_loggers           = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.timeout                 = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.tls_ciphers             = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] glance.tls_min_version         = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.backend_availability_zone = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.chap_password = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.chap_username =  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.disk_geometry = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.driver_client_cert = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.driver_client_cert_key = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.driver_data_namespace = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.driver_use_ssl = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.extra_capabilities = {} {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.filter_function = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.goodness_function = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.iscsi_target_flags =  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.iscsi_write_cache = on {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.iser_port     = 3260 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.lvm_share_target = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.lvm_type      = auto {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.num_shell_tries = 3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.replication_device = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.report_discard_supported = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.reserved_percentage = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.target_helper = tgtadm {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.target_port   = 3260 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.target_protocol = iscsi {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.trace_flags   = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.unique_fqdn_network = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.use_chap_auth = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.volume_backend_name = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.volume_clear  = zero {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.volume_clear_ionice = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.volume_clear_size = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_reports.file_event_handler = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_reports.log_dir           = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.backend_host       = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.chap_password      = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.chap_username      = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.disk_geometry      = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.driver_client_cert = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.extra_capabilities = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.filter_function    = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.goodness_function  = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.iser_helper        = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.iser_port          = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.lvm_type           = auto {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.replication_device = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.report_discard_supported = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.reserved_percentage = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.scst_target_driver = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.storage_protocol   = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.target_ip_address  = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.target_port        = 3260 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.trace_flags        = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.volume_clear       = zero {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] lvmdriver-1.volumes_dir        = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack sudo[76049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_notifications.driver = [] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_notifications.retry = -1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack sudo[76049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] key_manager.fixed_key          = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.barbican_api_version  = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.barbican_endpoint     = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.barbican_endpoint_type = public {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.barbican_region_name  = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.cafile                = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.certfile              = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.collect_timing        = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.insecure              = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.keyfile               = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.number_of_retries     = 60 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.retry_delay           = 1 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.send_service_user_token = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.split_loggers         = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.timeout               = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.tls_ciphers           = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.tls_min_version       = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.verify_ssl            = True {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican.verify_ssl_path       = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican_service_user.auth_section = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican_service_user.auth_type = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican_service_user.cafile   = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican_service_user.certfile = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican_service_user.collect_timing = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican_service_user.insecure = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican_service_user.keyfile  = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican_service_user.split_loggers = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican_service_user.timeout  = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican_service_user.tls_ciphers = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] barbican_service_user.tls_min_version = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.approle_role_id          = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.approle_secret_id        = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.auth_method              = approle {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.auth_path                = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.kv_mountpoint            = secret {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.kv_path                  = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.kv_version               = 2 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.namespace                = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.root_token_id            = **** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.ssl_ca_crt_file          = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.timeout                  = 60.0 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.token_file               = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.token_role               = None {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.use_ssl                  = False {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:09:25 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] ******************************************************************************** {{(pid=75890) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.076s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:25 devstack sudo[76049]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:25 devstack sudo[76184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:09:25 devstack sudo[76184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:25 devstack sudo[76184]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.268s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:09:25 devstack cinder-volume[76041]: INFO cinder.brick.local_dev.lvm [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:25 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:25 devstack sudo[76279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 18:09:25 devstack sudo[76279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:26 devstack sudo[76279]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:26 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:26 devstack cinder-volume[76041]: DEBUG cinder.brick.local_dev.lvm [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76041) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 29 18:09:26 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:26 devstack sudo[76366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:09:26 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:26 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:26 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.514s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:26 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:26 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:26 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:26 devstack sudo[76567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:09:26 devstack sudo[76567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:26 devstack sudo[76567]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:26 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.312s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:26 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:26 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:26 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:26 devstack sudo[76654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 29 18:09:26 devstack sudo[76654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:27 devstack sudo[76654]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:27 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.261s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:27 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:27 devstack sudo[76657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 18:09:27 devstack sudo[76657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:27 devstack sudo[76657]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:27 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.343s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:27 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:27 devstack sudo[76740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 18:09:27 devstack sudo[76740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:27 devstack sudo[76740]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:27 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:27 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:27 devstack sudo[76748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:09:27 devstack sudo[76748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:28 devstack sudo[76748]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:28 devstack sudo[76832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:09:28 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:28 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:28 devstack sudo[76836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:09:28 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:28 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:28 devstack cinder-volume[76041]: INFO cinder.volume.drivers.lvm [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:28 devstack sudo[76840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:09:28 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:28 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG cinder.volume.drivers.lvm [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Updating volume stats {{(pid=76041) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 18:09:28 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:28 devstack sudo[76843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 18:09:28 devstack sudo[76843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:29 devstack sudo[76843]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:29 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:29 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:29 devstack sudo[76858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:09:29 devstack sudo[76858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:29 devstack sudo[76858]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:29 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:29 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:29 devstack sudo[76861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:09:29 devstack sudo[76861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:29 devstack sudo[76861]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:29 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:29 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:29 devstack sudo[76864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:09:29 devstack sudo[76864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:30 devstack sudo[76864]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:30 devstack cinder-volume[76041]: INFO cinder.volume.driver [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Driver hasn't implemented _init_vendor_properties()
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG cinder.volume.driver [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76041) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG oslo_db.sqlalchemy.engines [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76041) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG dbcounter [-] [76041] Writer thread running {{(pid=76041) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG cinder.db.api [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Building query based on filter {{(pid=76041) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG cinder.image.image_utils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76041) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 29 18:09:30 devstack cinder-volume[76041]: INFO cinder.keymgr.migration [None req-35b69621-7bc1-48c6-b497-b9c85be3aa1c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG cinder.volume.drivers.lvm [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Updating volume stats {{(pid=76041) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:30 devstack sudo[76867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 18:09:30 devstack sudo[76867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:30 devstack sudo[76867]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:30 devstack sudo[76873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:09:30 devstack sudo[76873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:30 devstack sudo[76873]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:30 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:30 devstack sudo[76876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:09:30 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:31 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:31 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:31 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:31 devstack sudo[76879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:09:31 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:31 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:31 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:31 devstack cinder-volume[76041]: DEBUG cinder.manager [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Notifying Schedulers of capabilities ... {{(pid=76041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:09:31 devstack cinder-volume[76041]: INFO cinder.volume.manager [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Driver initialization completed successfully.
Sep 29 18:09:31 devstack cinder-volume[76041]: INFO cinder.manager [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Initiating service 2 cleanup
Sep 29 18:09:31 devstack cinder-volume[76041]: INFO cinder.manager [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Service 2 cleanup completed.
Sep 29 18:09:31 devstack cinder-volume[76041]: DEBUG cinder.service [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Creating RPC server for service cinder-volume {{(pid=76041) start /opt/stack/cinder/cinder/service.py:231}}
Sep 29 18:09:31 devstack cinder-volume[76041]: DEBUG cinder.service [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76041) start /opt/stack/cinder/cinder/service.py:237}}
Sep 29 18:09:31 devstack cinder-volume[76041]: INFO cinder.volume.manager [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 29 18:09:31 devstack cinder-volume[76041]: DEBUG cinder.volume.drivers.lvm [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Updating volume stats {{(pid=76041) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 18:09:31 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:31 devstack sudo[76883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 18:09:31 devstack sudo[76883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:31 devstack sudo[76883]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:31 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:31 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:31 devstack sudo[76888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:09:31 devstack sudo[76888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:32 devstack sudo[76888]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:32 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:32 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:32 devstack sudo[76891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:09:32 devstack sudo[76891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:32 devstack sudo[76891]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:32 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:32 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:09:32 devstack sudo[76897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:09:32 devstack sudo[76897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:09:32 devstack sudo[76897]: pam_unix(sudo:session): session closed for user root
Sep 29 18:09:32 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:09:32 devstack cinder-volume[76041]: INFO cinder.volume.manager [None req-438ac4ee-cd54-4646-9478-e6fe2f437d10 None None] Driver post RPC initialization completed successfully.
Sep 29 18:09:34 devstack cinder-volume[75890]: DEBUG dbcounter [-] [75890] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75890) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:09:38 devstack cinder-volume[76041]: DEBUG oslo_service.periodic_task [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running periodic task VolumeManager._thread_info {{(pid=76041) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:09:38 devstack cinder-volume[76041]: DEBUG cinder.volume.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] thread count: 6 {{(pid=76041) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:09:38 devstack cinder-volume[76041]: DEBUG cinder.volume.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] thread info: [<_MainThread(MainThread, started 128562993041536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128562878828544)>, <Thread(Thread-3 (stat_writer), started daemon 128562883060672)>, <Thread(Rabbit-heartbeat, started daemon 128562878204224)>, <Thread(Thread-5 (_runner), started daemon 128562878256512)>, <Thread(Thread-7 (_runner), started daemon 128562876340992)>] {{(pid=76041) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:09:41 devstack cinder-volume[76041]: DEBUG dbcounter [-] [76041] Writing DB stats cinder:SELECT=2 {{(pid=76041) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:09:42 devstack cinder-volume[76041]: DEBUG dbcounter [-] [76041] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76041) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:10:38 devstack cinder-volume[76041]: DEBUG oslo_service.periodic_task [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76041) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:10:38 devstack cinder-volume[76041]: DEBUG cinder.volume.drivers.lvm [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Updating volume stats {{(pid=76041) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 18:10:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:10:38 devstack sudo[79139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 18:10:38 devstack sudo[79139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:10:38 devstack sudo[79139]: pam_unix(sudo:session): session closed for user root
Sep 29 18:10:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:10:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:10:38 devstack sudo[79142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:10:38 devstack sudo[79142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:10:39 devstack sudo[79142]: pam_unix(sudo:session): session closed for user root
Sep 29 18:10:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:10:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:10:39 devstack sudo[79145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:10:39 devstack sudo[79145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:10:39 devstack sudo[79145]: pam_unix(sudo:session): session closed for user root
Sep 29 18:10:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:10:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:10:39 devstack sudo[79148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:10:39 devstack sudo[79148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:10:39 devstack sudo[79148]: pam_unix(sudo:session): session closed for user root
Sep 29 18:10:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:10:39 devstack cinder-volume[76041]: DEBUG cinder.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Notifying Schedulers of capabilities ... {{(pid=76041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:10:39 devstack cinder-volume[76041]: DEBUG oslo_service.periodic_task [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running periodic task VolumeManager._thread_info {{(pid=76041) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:10:39 devstack cinder-volume[76041]: DEBUG cinder.volume.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] thread count: 6 {{(pid=76041) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:10:39 devstack cinder-volume[76041]: DEBUG cinder.volume.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] thread info: [<_MainThread(MainThread, started 128562993041536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128562878828544)>, <Thread(Thread-3 (stat_writer), started daemon 128562883060672)>, <Thread(Rabbit-heartbeat, started daemon 128562878204224)>, <Thread(Thread-5 (_runner), started daemon 128562878256512)>, <Thread(Thread-7 (_runner), started daemon 128562876340992)>] {{(pid=76041) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:11:38 devstack cinder-volume[76041]: DEBUG oslo_service.periodic_task [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76041) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:11:38 devstack cinder-volume[76041]: DEBUG cinder.volume.drivers.lvm [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Updating volume stats {{(pid=76041) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 18:11:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:11:38 devstack sudo[82362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 18:11:38 devstack sudo[82362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:11:38 devstack sudo[82362]: pam_unix(sudo:session): session closed for user root
Sep 29 18:11:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:11:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:11:38 devstack sudo[82365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:11:38 devstack sudo[82365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:11:39 devstack sudo[82365]: pam_unix(sudo:session): session closed for user root
Sep 29 18:11:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:11:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:11:39 devstack sudo[82369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:11:39 devstack sudo[82369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:11:39 devstack sudo[82369]: pam_unix(sudo:session): session closed for user root
Sep 29 18:11:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:11:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:11:39 devstack sudo[82373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:11:39 devstack sudo[82373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:11:39 devstack sudo[82373]: pam_unix(sudo:session): session closed for user root
Sep 29 18:11:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:11:39 devstack cinder-volume[76041]: DEBUG cinder.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Notifying Schedulers of capabilities ... {{(pid=76041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:11:39 devstack cinder-volume[76041]: DEBUG oslo_service.periodic_task [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running periodic task VolumeManager._thread_info {{(pid=76041) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:11:39 devstack cinder-volume[76041]: DEBUG cinder.volume.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] thread count: 6 {{(pid=76041) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:11:39 devstack cinder-volume[76041]: DEBUG cinder.volume.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] thread info: [<_MainThread(MainThread, started 128562993041536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128562878828544)>, <Thread(Thread-3 (stat_writer), started daemon 128562883060672)>, <Thread(Rabbit-heartbeat, started daemon 128562878204224)>, <Thread(Thread-5 (_runner), started daemon 128562878256512)>, <Thread(Thread-7 (_runner), started daemon 128562876340992)>] {{(pid=76041) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:11:42 devstack cinder-volume[76041]: DEBUG dbcounter [-] [76041] Writing DB stats cinder:SELECT=1 {{(pid=76041) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:11:42 devstack cinder-volume[76041]: DEBUG dbcounter [-] [76041] Writing DB stats cinder:UPDATE=1 {{(pid=76041) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:12:38 devstack cinder-volume[76041]: DEBUG oslo_service.periodic_task [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76041) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:12:38 devstack cinder-volume[76041]: DEBUG cinder.volume.drivers.lvm [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Updating volume stats {{(pid=76041) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 18:12:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:12:38 devstack sudo[84412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 18:12:38 devstack sudo[84412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:12:38 devstack sudo[84412]: pam_unix(sudo:session): session closed for user root
Sep 29 18:12:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:12:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:12:38 devstack sudo[84420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:12:38 devstack sudo[84420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:12:39 devstack sudo[84420]: pam_unix(sudo:session): session closed for user root
Sep 29 18:12:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:12:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:12:39 devstack sudo[84438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:12:39 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:12:39 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root
Sep 29 18:12:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:12:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:12:39 devstack sudo[84467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:12:39 devstack sudo[84467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:12:39 devstack sudo[84467]: pam_unix(sudo:session): session closed for user root
Sep 29 18:12:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:12:39 devstack cinder-volume[76041]: DEBUG cinder.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Notifying Schedulers of capabilities ... {{(pid=76041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:13:38 devstack cinder-volume[76041]: DEBUG oslo_service.periodic_task [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76041) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:13:38 devstack cinder-volume[76041]: DEBUG cinder.volume.drivers.lvm [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Updating volume stats {{(pid=76041) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 29 18:13:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:13:38 devstack sudo[85590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 29 18:13:38 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:13:38 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root
Sep 29 18:13:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:13:38 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:13:38 devstack sudo[85604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:13:38 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:13:39 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root
Sep 29 18:13:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:13:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:13:39 devstack sudo[85607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 29 18:13:39 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:13:39 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root
Sep 29 18:13:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:13:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:13:39 devstack sudo[85625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 29 18:13:39 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:13:39 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root
Sep 29 18:13:39 devstack cinder-volume[76041]: DEBUG oslo_concurrency.processutils [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76041) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:13:39 devstack cinder-volume[76041]: DEBUG cinder.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Notifying Schedulers of capabilities ... {{(pid=76041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:13:39 devstack cinder-volume[76041]: DEBUG oslo_service.periodic_task [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] Running periodic task VolumeManager._thread_info {{(pid=76041) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:13:39 devstack cinder-volume[76041]: DEBUG cinder.volume.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] thread count: 6 {{(pid=76041) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:13:39 devstack cinder-volume[76041]: DEBUG cinder.volume.manager [None req-53d2456b-2d4a-443f-84a9-4982440fe7fb None None] thread info: [<_MainThread(MainThread, started 128562993041536)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128562878828544)>, <Thread(Thread-3 (stat_writer), started daemon 128562883060672)>, <Thread(Rabbit-heartbeat, started daemon 128562878204224)>, <Thread(Thread-5 (_runner), started daemon 128562878256512)>, <Thread(Thread-7 (_runner), started daemon 128562876340992)>] {{(pid=76041) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:13:42 devstack cinder-volume[76041]: DEBUG dbcounter [-] [76041] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76041) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:13:50 devstack cinder-volume[75890]: INFO oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Caught SIGTERM, stopping children
Sep 29 18:13:50 devstack cinder-volume[75890]: DEBUG oslo_concurrency.lockutils [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Acquiring lock "singleton_lock" {{(pid=75890) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 18:13:50 devstack cinder-volume[75890]: DEBUG oslo_concurrency.lockutils [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Acquired lock "singleton_lock" {{(pid=75890) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 18:13:50 devstack cinder-volume[75890]: DEBUG oslo_concurrency.lockutils [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Releasing lock "singleton_lock" {{(pid=75890) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 18:13:50 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Stop services. {{(pid=75890) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 29 18:13:50 devstack cinder-volume[75890]: DEBUG oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Killing children. {{(pid=75890) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 29 18:13:50 devstack cinder-volume[75890]: INFO oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Waiting on 1 children to exit
Sep 29 18:13:51 devstack cinder-volume[76041]: DEBUG oslo_concurrency.lockutils [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Acquiring lock "singleton_lock" {{(pid=76041) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 18:13:51 devstack cinder-volume[76041]: DEBUG oslo_concurrency.lockutils [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Acquired lock "singleton_lock" {{(pid=76041) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 18:13:51 devstack cinder-volume[76041]: DEBUG oslo_concurrency.lockutils [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Releasing lock "singleton_lock" {{(pid=76041) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 18:13:51 devstack cinder-volume[76041]: WARNING amqp [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 18:13:51 devstack cinder-volume[76041]: WARNING amqp [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 18:13:51 devstack cinder-volume[75890]: INFO oslo_service.backend._eventlet.service [None req-574d112c-fcaf-4d6c-9161-1f9c490de736 None None] Child 76041 exited with status 0
Sep 29 18:13:51 devstack cinder-volume[85981]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 29 18:13:51 devstack cinder-volume[85981]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 18:13:51 devstack cinder-volume[85981]: we strongly recommend against using it for new projects.
Sep 29 18:13:51 devstack cinder-volume[85981]: If you are already using Eventlet, we recommend migrating to a different
Sep 29 18:13:51 devstack cinder-volume[85981]: framework.  For more detail see
Sep 29 18:13:51 devstack cinder-volume[85981]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 18:13:51 devstack cinder-volume[85981]:   import eventlet  # noqa
Sep 29 18:13:53 devstack cinder-volume[85981]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 18:13:53 devstack cinder-volume[85981]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 18:13:53 devstack cinder-volume[85981]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 18:13:54 devstack cinder-volume[85981]: INFO dbcounter [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Registered counter for database cinder
Sep 29 18:13:54 devstack cinder-volume[85981]: DEBUG oslo_db.sqlalchemy.engines [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85981) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:13:54 devstack cinder-volume[85981]: DEBUG dbcounter [-] [85981] Writer thread running {{(pid=85981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 18:13:54 devstack cinder-volume[85981]: INFO cinder.rpc [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 29 18:13:54 devstack cinder-volume[85981]: INFO cinder.rpc [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_db.sqlalchemy.engines [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85981) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:13:55 devstack cinder-volume[85981]: INFO cinder.volume.manager [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Determined volume DB was empty at startup.
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG cinder.volume.manager [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85981) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 29 18:13:55 devstack cinder-volume[85981]: INFO cinder.volume.manager [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 29 18:13:55 devstack cinder-volume[85981]: WARNING stevedore.named [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 18:13:55 devstack cinder-volume[85981]: WARNING castellan.key_manager [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 18:13:55 devstack cinder-volume[85981]: WARNING cinder.keymgr.conf_key_mgr [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 18:13:55 devstack cinder-volume[85981]: INFO cinder.volume.manager [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_db.sqlalchemy.engines [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85981) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:13:55 devstack cinder-volume[85981]: INFO oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Starting 1 workers
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Started child 86194 {{(pid=85981) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Full set of CONF: {{(pid=85981) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] ******************************************************************************** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Configuration options gathered from: {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] ================================================================================ {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] allow_availability_zone_fallback = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] allow_compression_on_image_upload = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] allowed_direct_url_schemes     = [] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[86194]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] api_rate_limit                 = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] auth_strategy                  = keystone {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_availability_zone      = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_host                   = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_name                   = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_stats_polling_interval = 60 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backup_api_class               = cinder.backup.api.API {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backup_name_template           = backup-%s {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backup_use_same_host           = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backup_use_temp_snapshot       = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] chap_password                  = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] chap_username                  =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cinder_internal_tenant_project_id = 6a572c5ac5e348eea6e83501d74e788f {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cinder_internal_tenant_user_id = 17c062f3adb34747a59d5a887c003800 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cluster                        = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] compression_format             = gzip {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] compute_api_class              = cinder.compute.nova.API {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] config_dir                     = [] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] config_source                  = [] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] control_exchange               = openstack {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] debug                          = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] default_availability_zone      = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] default_group_type             = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] default_volume_type            = QuobyteHD {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] disk_geometry                  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] driver_client_cert             = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] driver_client_cert_key         = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] driver_data_namespace          = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] driver_ssl_cert_path           = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] driver_ssl_cert_verify         = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] driver_use_ssl                 = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] enable_new_services            = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] enable_unsupported_driver      = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] enabled_backends               = ['QuobyteHD'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] enforce_multipath_for_image_xfer = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] filter_function                = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance_api_insecure            = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance_api_servers             = ['http://192.168.122.251/image'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance_api_ssl_compression     = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance_ca_certificates_file    = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance_catalog_info            = image:glance:publicURL {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance_certfile                = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance_keyfile                 = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance_num_retries             = 3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance_request_timeout         = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] goodness_function              = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] graceful_shutdown_timeout      = 5 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] group_api_class                = cinder.group.api.API {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] host                           = devstack {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_compress_on_upload       = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_conversion_address_space_limit = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_conversion_cpu_limit     = 60 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[86194]: INFO cinder.volume.manager [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_conversion_disable       = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_introspection_address_space_limit = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_introspection_cpu_limit  = 60 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_upload_use_cinder_backend = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_upload_use_internal_tenant = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[86194]: DEBUG cinder.volume.drivers.remotefs [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86194) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_volume_cache_enabled     = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_volume_cache_max_count   = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] image_volume_cache_max_size_gb = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] init_host_max_objects_retrieval = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] instance_format                = [instance: %(uuid)s]  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] iscsi_target_flags             =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] iscsi_write_cache              = on {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] iser_helper                    = tgtadm {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] iser_ip_address                = 192.168.122.251 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] iser_port                      = 3260 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] log_color                      = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] log_config_append              = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] log_dir                        = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] log_file                       = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] log_options                    = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] log_rotate_interval            = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] log_rotate_interval_type       = days {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] log_rotation_type              = none {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] max_age                        = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] max_logfile_count              = 30 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] max_logfile_size_mb            = 200 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] max_over_subscription_ratio    = 20.0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] message_reap_interval          = 86400 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] message_ttl                    = 2592000 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] migration_create_volume_timeout_secs = 300 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] monkey_patch                   = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] monkey_patch_modules           = [] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] my_ip                          = 192.168.122.251 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] no_snapshot_gb_quota           = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] num_iser_scan_tries            = 3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] num_shell_tries                = 3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] num_volume_device_scan_tries   = 3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] nvmeof_conn_info_version       = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] nvmet_ns_id                    = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] nvmet_port_id                  = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] osapi_max_limit                = 1000 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] osapi_volume_ext_list          = [] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] osapi_volume_listen_port       = 8776 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[86194]: DEBUG cinder.volume.drivers.quobyte [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86194) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 29 18:13:55 devstack cinder-volume[86194]: WARNING cinder.volume.drivers.quobyte [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 29 18:13:55 devstack cinder-volume[86194]: WARNING cinder.volume.drivers.quobyte [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 29 18:13:55 devstack cinder-volume[86194]: DEBUG oslo_concurrency.processutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Running cmd (subprocess): mount.quobyte {{(pid=86194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] osapi_volume_use_ssl           = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] osapi_volume_workers           = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] per_volume_size_limit          = -1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] periodic_fuzzy_delay           = 60 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] periodic_interval              = 60 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] public_endpoint                = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] publish_errors                 = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] quota_backup_gigabytes         = 1000 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] quota_backups                  = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] quota_gigabytes                = 1000 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] quota_groups                   = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] quota_snapshots                = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] quota_volumes                  = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] rate_limit_burst               = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] rate_limit_except_level        = CRITICAL {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] rate_limit_interval            = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] reinit_driver_count            = 3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] replication_device             = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] report_discard_supported       = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] report_interval                = 120 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] reservation_clean_interval     = 86400 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] reservation_expire             = 86400 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] reserved_image_namespaces      = [] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] reserved_percentage            = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] rpc_response_timeout           = 120 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] run_external_periodic_tasks    = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] scst_target_driver             = iscsi {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] scst_target_iqn_name           = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_down_time              = 720 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] shell_completion               = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] snapshot_name_template         = snapshot-%s {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] split_loggers                  = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] state_path                     = /opt/stack/data/cinder {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] storage_availability_zone      = nova {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] storage_protocol               = iSCSI {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] syslog_log_facility            = LOG_USER {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] target_helper                  = lioadm {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] target_ip_address              = 192.168.122.251 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] target_port                    = 3260 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] target_protocol                = iscsi {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] target_secondary_ip_addresses  = [] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] trace_flags                    = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] transport_url                  = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] until_refresh                  = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] use_chap_auth                  = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] use_default_quota_class        = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] use_journal                    = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] use_json                       = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] use_multipath_for_image_xfer   = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] use_stderr                     = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] use_syslog                     = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] verify_glance_signatures       = enabled {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_api_class               = cinder.volume.api.API {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_backend_name            = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_clear                   = zero {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_clear_ionice            = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_clear_size              = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_copy_bps_limit          = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_dd_blocksize            = 1M {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_name_template           = volume-%s {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_service_inithost_offload = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volume_usage_audit_period      = month {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] zoning_mode                    = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_concurrency.disable_process_locking = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.auth_section = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.auth_type   = password {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.auth_version = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.cache       = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.certfile    = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.delay_auth_decision = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.http_connect_timeout = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.include_service_catalog = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.insecure    = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.interface   = public {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.keyfile     = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_password = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcache_username = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.region_name = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.service_token_roles_required = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.service_type = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.token_cache_time = 300 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.backend                  = dogpile.cache.null {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.backend_argument         = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.backend_expiration_time  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.config_prefix            = cache.oslo {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.debug_cache_backend      = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.enable_retry_client      = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.enable_socket_keepalive  = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.enabled                  = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.expiration_time          = 600 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.hashclient_retry_attempts = 2 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.memcache_dead_retry      = 300 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.memcache_pool_maxsize    = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.memcache_sasl_enabled    = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.password                 = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.proxies                  = [] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.redis_db                 = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.redis_sentinel_service_name = mymaster {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.redis_server             = localhost:6379 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.retry_attempts           = 2 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.retry_delay              = 0.0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.socket_keepalive_count   = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.socket_keepalive_idle    = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.socket_keepalive_interval = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.socket_timeout           = 1.0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.tls_allowed_ciphers      = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.tls_cafile               = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.tls_certfile             = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.tls_enabled              = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.tls_keyfile              = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cache.username                 = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] coordination.backend_url       = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.asyncio_connection    = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.asyncio_slave_connection = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack quobyte-client[86195]: Reading configuration file: /etc/quobyte/client.cfg
Sep 29 18:13:55 devstack quobyte-client[86195]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 29 18:13:55 devstack cinder-volume[86194]: DEBUG oslo_concurrency.processutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] CMD "mount.quobyte" returned: 1 in 0.119s {{(pid=86194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:13:55 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.backend               = sqlalchemy {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.connection            = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[86194]: DEBUG cinder.volume.drivers.quobyte [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86194) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.connection_debug      = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.connection_parameters =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.connection_recycle_time = 3600 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.connection_trace      = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.db_inc_retry_interval = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.db_max_retries        = 20 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.db_max_retry_interval = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[86194]: INFO cinder.volume.drivers.quobyte [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 ...
Sep 29 18:13:55 devstack cinder-volume[86194]: DEBUG oslo_concurrency.processutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 -c /etc/quobyte/client-cinder.cfg {{(pid=86194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.db_retry_interval     = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.max_overflow          = 50 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.max_pool_size         = 5 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.max_retries           = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.mysql_wsrep_sync_wait = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.pool_timeout          = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.retry_interval        = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.slave_connection      = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.sqlite_synchronous    = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.synchronous_reader    = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] database.use_db_reconnect      = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_tracing.insecure = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler.connection_string     = messaging:// {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler.enabled               = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler.es_doc_type           = notification {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler.es_scroll_size        = 10000 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack sudo[86198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 -c /etc/quobyte/client-cinder.cfg
Sep 29 18:13:55 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler.es_scroll_time        = 2m {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler.filter_error_trace    = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler.hmac_keys             = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler.sentinel_service_name = mymaster {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler.socket_timeout        = 0.1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler.trace_requests        = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler.trace_sqlalchemy      = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler_jaeger.process_tags   = {} {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler_jaeger.service_name_prefix = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] profiler_otlp.service_name_prefix = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_policy.enforce_new_defaults = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_policy.policy_default_rule = default {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_policy.policy_file        = policy.yaml {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] privsep_osbrick.group          = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] privsep_osbrick.helper_command = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] privsep_osbrick.user           = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cinder_sys_admin.group         = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cinder_sys_admin.helper_command = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] cinder_sys_admin.user          = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.auth_section      = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.auth_type         = password {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.cafile            = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.certfile          = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.collect_timing    = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.insecure          = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.keyfile           = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.send_service_user_token = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.split_loggers     = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.timeout           = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.tls_ciphers       = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] service_user.tls_min_version   = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.auth_section            = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.auth_type               = password {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.certfile                = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.collect_timing          = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.insecure                = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.keyfile                 = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.region_name             = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.split_loggers           = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.timeout                 = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.tls_ciphers             = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] glance.tls_min_version         = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.backend_availability_zone = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.chap_password = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.chap_username =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.disk_geometry = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.driver_client_cert = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.driver_client_cert_key = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.driver_data_namespace = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.driver_use_ssl = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.enable_unsupported_driver = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.extra_capabilities = {} {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.filter_function = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.goodness_function = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.iscsi_target_flags =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.iscsi_write_cache = on {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.iser_helper   = tgtadm {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.iser_port     = 3260 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nas_host      =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nas_login     = admin {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nas_mount_options = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nas_password  = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nas_private_key =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nas_share_path =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.num_shell_tries = 3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.nvmet_port_id = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.quobyte_client_cfg = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.quobyte_volume_url = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.replication_device = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.report_discard_supported = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.reserved_percentage = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.scst_target_driver = iscsi {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.scst_target_iqn_name = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.storage_protocol = iSCSI {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.target_helper = tgtadm {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.target_port   = 3260 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.target_protocol = iscsi {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.trace_flags   = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.unique_fqdn_network = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.use_chap_auth = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.volume_backend_name = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.volume_clear  = zero {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.volume_clear_ionice = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.volume_clear_size = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_reports.file_event_handler = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_reports.log_dir           = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.backend_availability_zone = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.backend_host         = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.chap_password        = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.chap_username        = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.chiscsi_conf         = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.disk_geometry        = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.driver_client_cert   = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.driver_client_cert_key = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.driver_data_namespace = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.driver_use_ssl       = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.extra_capabilities   = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.filter_function      = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.goodness_function    = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.iser_helper          = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.iser_ip_address      = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.iser_port            = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.iser_target_prefix   = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nas_host             = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nas_login            = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nas_mount_options    = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nas_password         = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nas_private_key      = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nas_share_path       = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nas_ssh_port         = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.num_shell_tries      = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.nvmet_port_id        = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.replication_device   = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.report_discard_supported = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.reserved_percentage  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.scst_target_driver   = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.storage_protocol     = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.target_helper        = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.target_ip_address    = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.target_port          = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.target_prefix        = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.target_protocol      = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.trace_flags          = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.use_chap_auth        = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.volume_clear         = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.volume_clear_size    = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] QuobyteHD.volumes_dir          = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.ssl      = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_notifications.driver = [] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_notifications.retry = -1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] oslo_messaging_notifications.transport_url = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] key_manager.fixed_key          = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.barbican_api_version  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.barbican_endpoint     = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.barbican_endpoint_type = public {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.barbican_region_name  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.cafile                = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.certfile              = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.collect_timing        = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.insecure              = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.keyfile               = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.number_of_retries     = 60 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.retry_delay           = 1 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.send_service_user_token = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.split_loggers         = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.timeout               = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.tls_ciphers           = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.tls_min_version       = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.verify_ssl            = True {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican.verify_ssl_path       = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican_service_user.auth_section = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican_service_user.auth_type = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican_service_user.cafile   = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican_service_user.certfile = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican_service_user.collect_timing = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican_service_user.insecure = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican_service_user.keyfile  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican_service_user.split_loggers = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican_service_user.timeout  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican_service_user.tls_ciphers = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] barbican_service_user.tls_min_version = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.approle_role_id          = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.approle_secret_id        = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.auth_method              = approle {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.auth_path                = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.kv_mountpoint            = secret {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.kv_path                  = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.kv_version               = 2 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.namespace                = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.root_token_id            = **** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.ssl_ca_crt_file          = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.timeout                  = 60.0 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.token_file               = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.token_role               = None {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.use_ssl                  = False {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:13:55 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] ******************************************************************************** {{(pid=85981) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 29 18:13:56 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.processutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.481s {{(pid=86194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:13:56 devstack cinder-volume[86194]: INFO cinder.volume.drivers.quobyte [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 succeeded
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG cinder.volume.drivers.quobyte [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86194) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.496s {{(pid=86194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.processutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:13:56 devstack sudo[86302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:13:56 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:13:56 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.processutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.250s {{(pid=86194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:13:56 devstack cinder-volume[86194]: INFO cinder.volume.driver [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Driver hasn't implemented _init_vendor_properties()
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG cinder.volume.driver [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.014518737793, 'free_capacity_gb': 1775.014518737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86194) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_db.sqlalchemy.engines [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86194) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG dbcounter [-] [86194] Writer thread running {{(pid=86194) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG cinder.db.api [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Building query based on filter {{(pid=86194) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG cinder.image.image_utils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86194) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 29 18:13:56 devstack cinder-volume[86194]: INFO cinder.keymgr.migration [None req-7d918e6f-dff3-4cf7-9a7b-573a7620bc47 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG cinder.volume.drivers.quobyte [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86194) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG cinder.volume.drivers.quobyte [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86194) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.processutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:13:56 devstack sudo[86305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:13:56 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:13:56 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.processutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.222s {{(pid=86194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG cinder.manager [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Notifying Schedulers of capabilities ... {{(pid=86194) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:13:56 devstack cinder-volume[86194]: INFO cinder.volume.manager [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Driver initialization completed successfully.
Sep 29 18:13:56 devstack cinder-volume[86194]: INFO cinder.manager [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Initiating service 3 cleanup
Sep 29 18:13:56 devstack cinder-volume[86194]: INFO cinder.manager [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Service 3 cleanup completed.
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG cinder.service [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Creating RPC server for service cinder-volume {{(pid=86194) start /opt/stack/cinder/cinder/service.py:231}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG cinder.service [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86194) start /opt/stack/cinder/cinder/service.py:237}}
Sep 29 18:13:56 devstack cinder-volume[86194]: INFO cinder.volume.manager [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG cinder.volume.drivers.quobyte [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86194) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG cinder.volume.drivers.quobyte [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86194) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86194) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:13:56 devstack cinder-volume[86194]: DEBUG oslo_concurrency.processutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:13:56 devstack sudo[86309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:13:56 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:13:57 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root
Sep 29 18:13:57 devstack cinder-volume[86194]: DEBUG oslo_concurrency.processutils [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.273s {{(pid=86194) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:13:57 devstack cinder-volume[86194]: INFO cinder.volume.manager [None req-9b14913e-7f06-4221-a529-d78b700b6ecc None None] Driver post RPC initialization completed successfully.
Sep 29 18:14:01 devstack cinder-volume[85981]: INFO oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Caught SIGTERM, stopping children
Sep 29 18:14:01 devstack cinder-volume[85981]: DEBUG oslo_concurrency.lockutils [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Acquiring lock "singleton_lock" {{(pid=85981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 18:14:01 devstack cinder-volume[85981]: DEBUG oslo_concurrency.lockutils [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Acquired lock "singleton_lock" {{(pid=85981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 18:14:01 devstack cinder-volume[85981]: DEBUG oslo_concurrency.lockutils [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Releasing lock "singleton_lock" {{(pid=85981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 18:14:01 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Stop services. {{(pid=85981) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 29 18:14:01 devstack cinder-volume[85981]: DEBUG oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Killing children. {{(pid=85981) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 29 18:14:01 devstack cinder-volume[85981]: INFO oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Waiting on 1 children to exit
Sep 29 18:14:05 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Acquiring lock "singleton_lock" {{(pid=86194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 18:14:05 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Acquired lock "singleton_lock" {{(pid=86194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 18:14:05 devstack cinder-volume[86194]: DEBUG oslo_concurrency.lockutils [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Releasing lock "singleton_lock" {{(pid=86194) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 18:14:05 devstack cinder-volume[86194]: WARNING amqp [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 18:14:05 devstack cinder-volume[86194]: WARNING amqp [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 29 18:14:05 devstack cinder-volume[85981]: INFO oslo_service.backend._eventlet.service [None req-827f281c-bbfa-4387-b720-ffa7098c451e None None] Child 86194 exited with status 0
Sep 29 18:14:05 devstack cinder-volume[86510]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 29 18:14:05 devstack cinder-volume[86510]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 18:14:05 devstack cinder-volume[86510]: we strongly recommend against using it for new projects.
Sep 29 18:14:05 devstack cinder-volume[86510]: If you are already using Eventlet, we recommend migrating to a different
Sep 29 18:14:05 devstack cinder-volume[86510]: framework.  For more detail see
Sep 29 18:14:05 devstack cinder-volume[86510]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 18:14:05 devstack cinder-volume[86510]:   import eventlet  # noqa
Sep 29 18:14:08 devstack cinder-volume[86510]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 29 18:14:08 devstack cinder-volume[86510]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 29 18:14:08 devstack cinder-volume[86510]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 29 18:14:09 devstack cinder-volume[86510]: INFO dbcounter [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Registered counter for database cinder
Sep 29 18:14:09 devstack cinder-volume[86510]: DEBUG oslo_db.sqlalchemy.engines [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:14:09 devstack cinder-volume[86510]: DEBUG dbcounter [-] [86510] Writer thread running {{(pid=86510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 18:14:09 devstack cinder-volume[86510]: INFO cinder.rpc [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 29 18:14:09 devstack cinder-volume[86510]: INFO cinder.rpc [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 29 18:14:09 devstack cinder-volume[86510]: DEBUG oslo_db.sqlalchemy.engines [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:14:09 devstack cinder-volume[86510]: INFO cinder.volume.manager [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Determined volume DB was empty at startup.
Sep 29 18:14:09 devstack cinder-volume[86510]: DEBUG cinder.volume.manager [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86510) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 29 18:14:09 devstack cinder-volume[86510]: WARNING stevedore.named [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 29 18:14:09 devstack cinder-volume[86510]: WARNING castellan.key_manager [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 18:14:09 devstack cinder-volume[86510]: WARNING cinder.keymgr.conf_key_mgr [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 29 18:14:09 devstack cinder-volume[86510]: INFO cinder.volume.manager [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 29 18:14:09 devstack cinder-volume[86510]: DEBUG oslo_db.sqlalchemy.engines [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:14:09 devstack cinder-volume[86510]: INFO oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Starting 1 workers
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Started child 86821 {{(pid=86510) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Full set of CONF: {{(pid=86510) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] ******************************************************************************** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] Configuration options gathered from: {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] ================================================================================ {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] allow_availability_zone_fallback = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] allow_compression_on_image_upload = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] allowed_direct_url_schemes     = [] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] api_rate_limit                 = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] auth_strategy                  = keystone {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_availability_zone      = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_host                   = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_name                   = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86821]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0)
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_stats_polling_interval = 60 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backup_api_class               = cinder.backup.api.API {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backup_name_template           = backup-%s {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backup_use_same_host           = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backup_use_temp_snapshot       = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] chap_password                  = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] chap_username                  =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cinder_internal_tenant_project_id = 6a572c5ac5e348eea6e83501d74e788f {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cinder_internal_tenant_user_id = 17c062f3adb34747a59d5a887c003800 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cluster                        = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] compression_format             = gzip {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] config_dir                     = [] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] config_source                  = [] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] control_exchange               = openstack {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] debug                          = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] default_availability_zone      = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] default_group_type             = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] default_volume_type            = QuobyteHD {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] disk_geometry                  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] driver_client_cert             = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] driver_client_cert_key         = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] driver_data_namespace          = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] driver_ssl_cert_path           = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] driver_ssl_cert_verify         = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] driver_use_ssl                 = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] enable_new_services            = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] enable_unsupported_driver      = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] enforce_multipath_for_image_xfer = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] filter_function                = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance_api_insecure            = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance_api_servers             = ['http://192.168.122.251/image'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance_api_ssl_compression     = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance_ca_certificates_file    = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance_certfile                = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance_keyfile                 = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance_num_retries             = 3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance_request_timeout         = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] goodness_function              = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] graceful_shutdown_timeout      = 5 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] group_api_class                = cinder.group.api.API {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] host                           = devstack {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_compress_on_upload       = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_conversion_address_space_limit = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_conversion_cpu_limit     = 60 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_conversion_disable       = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_introspection_address_space_limit = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_introspection_cpu_limit  = 60 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_upload_use_cinder_backend = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_upload_use_internal_tenant = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_volume_cache_enabled     = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_volume_cache_max_count   = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] image_volume_cache_max_size_gb = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] init_host_max_objects_retrieval = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] iscsi_target_flags             =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] iscsi_write_cache              = on {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] iser_helper                    = tgtadm {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] iser_ip_address                = 192.168.122.251 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] iser_port                      = 3260 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] log_color                      = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] log_config_append              = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] log_dir                        = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] log_file                       = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] log_options                    = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] log_rotate_interval            = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] log_rotate_interval_type       = days {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] log_rotation_type              = none {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] max_age                        = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] max_logfile_count              = 30 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] max_logfile_size_mb            = 200 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] max_over_subscription_ratio    = 20.0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] message_reap_interval          = 86400 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] message_ttl                    = 2592000 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] migration_create_volume_timeout_secs = 300 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] monkey_patch                   = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] monkey_patch_modules           = [] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] my_ip                          = 192.168.122.251 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] no_snapshot_gb_quota           = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] num_iser_scan_tries            = 3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] num_shell_tries                = 3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] num_volume_device_scan_tries   = 3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] nvmeof_conn_info_version       = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] nvmet_ns_id                    = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] nvmet_port_id                  = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] osapi_max_limit                = 1000 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] osapi_volume_ext_list          = [] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] osapi_volume_listen_port       = 8776 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] osapi_volume_use_ssl           = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] osapi_volume_workers           = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] per_volume_size_limit          = -1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] periodic_fuzzy_delay           = 60 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] periodic_interval              = 60 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] public_endpoint                = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] publish_errors                 = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] quota_backup_gigabytes         = 1000 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] quota_backups                  = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] quota_gigabytes                = 1000 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] quota_groups                   = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] quota_snapshots                = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] quota_volumes                  = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] rate_limit_burst               = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] rate_limit_except_level        = CRITICAL {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] rate_limit_interval            = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] reinit_driver_count            = 3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] replication_device             = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] report_discard_supported       = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] report_interval                = 120 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] reservation_clean_interval     = 86400 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] reservation_expire             = 86400 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] reserved_image_namespaces      = [] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] reserved_percentage            = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] rpc_response_timeout           = 120 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] run_external_periodic_tasks    = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] scst_target_driver             = iscsi {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] scst_target_iqn_name           = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_down_time              = 720 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] shell_completion               = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] snapshot_name_template         = snapshot-%s {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] split_loggers                  = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] state_path                     = /opt/stack/data/cinder {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] storage_availability_zone      = nova {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] storage_protocol               = iSCSI {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] syslog_log_facility            = LOG_USER {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] target_helper                  = lioadm {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] target_ip_address              = 192.168.122.251 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] target_port                    = 3260 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] target_protocol                = iscsi {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] target_secondary_ip_addresses  = [] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] trace_flags                    = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] transport_url                  = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] until_refresh                  = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] use_chap_auth                  = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] use_default_quota_class        = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] use_journal                    = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] use_json                       = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] use_multipath_for_image_xfer   = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] use_stderr                     = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] use_syslog                     = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] verify_glance_signatures       = enabled {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_api_class               = cinder.volume.api.API {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_backend_name            = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_clear                   = zero {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_clear_ionice            = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_clear_size              = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_copy_bps_limit          = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_dd_blocksize            = 1M {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_name_template           = volume-%s {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_service_inithost_offload = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volume_usage_audit_period      = month {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] zoning_mode                    = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_concurrency.disable_process_locking = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86821) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.auth_section = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.auth_type   = password {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.auth_version = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.cache       = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.certfile    = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.include_service_catalog = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.insecure    = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.interface   = public {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.keyfile     = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_password = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcache_username = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.region_name = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.service_type = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.backend                  = dogpile.cache.null {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.backend_argument         = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.backend_expiration_time  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.config_prefix            = cache.oslo {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.debug_cache_backend      = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.enable_retry_client      = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.enable_socket_keepalive  = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.enabled                  = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.expiration_time          = 600 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.hashclient_retry_attempts = 2 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.memcache_dead_retry      = 300 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.memcache_sasl_enabled    = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.password                 = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.proxies                  = [] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.redis_db                 = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.redis_server             = localhost:6379 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.retry_attempts           = 2 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.retry_delay              = 0.0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.socket_keepalive_count   = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.socket_keepalive_idle    = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.socket_keepalive_interval = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.socket_timeout           = 1.0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.tls_allowed_ciphers      = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.tls_cafile               = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.tls_certfile             = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.tls_enabled              = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.tls_keyfile              = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cache.username                 = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] coordination.backend_url       = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.asyncio_connection    = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.asyncio_slave_connection = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.backend               = sqlalchemy {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.connection            = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.connection_debug      = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.connection_parameters =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.connection_recycle_time = 3600 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.connection_trace      = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.db_inc_retry_interval = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.db_max_retries        = 20 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.db_max_retry_interval = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.db_retry_interval     = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.max_overflow          = 50 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.max_pool_size         = 5 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.max_retries           = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.mysql_wsrep_sync_wait = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.pool_timeout          = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.retry_interval        = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.slave_connection      = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.sqlite_synchronous    = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.synchronous_reader    = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] database.use_db_reconnect      = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_tracing.insecure = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler.connection_string     = messaging:// {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler.enabled               = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler.es_doc_type           = notification {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler.es_scroll_size        = 10000 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler.es_scroll_time        = 2m {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler.filter_error_trace    = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler.hmac_keys             = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler.sentinel_service_name = mymaster {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler.socket_timeout        = 0.1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler.trace_requests        = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler.trace_sqlalchemy      = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler_jaeger.process_tags   = {} {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler_jaeger.service_name_prefix = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] profiler_otlp.service_name_prefix = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_policy.enforce_new_defaults = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_policy.policy_default_rule = default {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] privsep_osbrick.group          = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] privsep_osbrick.helper_command = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] privsep_osbrick.user           = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cinder_sys_admin.group         = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cinder_sys_admin.helper_command = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] cinder_sys_admin.user          = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.auth_section      = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.auth_type         = password {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.cafile            = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.certfile          = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.collect_timing    = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.insecure          = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.keyfile           = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.send_service_user_token = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.split_loggers     = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.timeout           = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.tls_ciphers       = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] service_user.tls_min_version   = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.auth_section            = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.auth_type               = password {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.certfile                = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.collect_timing          = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.insecure                = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.keyfile                 = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.region_name             = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.split_loggers           = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.timeout                 = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.tls_ciphers             = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] glance.tls_min_version         = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.backend_availability_zone = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.chap_password = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.chap_username =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.disk_geometry = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.driver_client_cert = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.driver_client_cert_key = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.driver_data_namespace = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.driver_use_ssl = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86821) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.extra_capabilities = {} {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.quobyte [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 29 18:14:10 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.quobyte [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Running cmd (subprocess): mount.quobyte {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.filter_function = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.goodness_function = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.iscsi_target_flags =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.iscsi_write_cache = on {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.iser_port     = 3260 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nas_host      =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nas_login     = admin {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nas_mount_options = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nas_password  = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nas_private_key =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nas_share_path =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.num_shell_tries = 3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.quobyte_volume_url = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.replication_device = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.report_discard_supported = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.reserved_percentage = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.target_helper = tgtadm {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.target_port   = 3260 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.target_protocol = iscsi {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.trace_flags   = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.unique_fqdn_network = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.use_chap_auth = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.volume_backend_name = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.volume_clear  = zero {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.volume_clear_ionice = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.volume_clear_size = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_reports.file_event_handler = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_reports.log_dir           = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.backend_availability_zone = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.backend_host         = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.chap_password        = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.chap_username        = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.disk_geometry        = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.driver_client_cert   = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.driver_data_namespace = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.extra_capabilities   = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.filter_function      = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.goodness_function    = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.iser_helper          = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.iser_ip_address      = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.iser_port            = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nas_host             = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nas_login            = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nas_mount_options    = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nas_password         = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nas_private_key      = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nas_share_path       = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.num_shell_tries      = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.replication_device   = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.report_discard_supported = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.reserved_percentage  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.scst_target_driver   = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.storage_protocol     = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.target_helper        = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.target_ip_address    = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.target_port          = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.target_prefix        = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.target_protocol      = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.trace_flags          = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.use_chap_auth        = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.volume_clear         = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.volume_clear_size    = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] QuobyteHD.volumes_dir          = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack quobyte-client[86823]: Reading configuration file: /etc/quobyte/client.cfg
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack quobyte-client[86823]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_notifications.driver = [] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_notifications.retry = -1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] key_manager.fixed_key          = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.barbican_api_version  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.barbican_endpoint     = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.barbican_endpoint_type = public {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.barbican_region_name  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.cafile                = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.certfile              = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.collect_timing        = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.insecure              = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.keyfile               = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.number_of_retries     = 60 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.retry_delay           = 1 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.send_service_user_token = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.split_loggers         = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.timeout               = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.tls_ciphers           = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.tls_min_version       = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.verify_ssl            = True {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican.verify_ssl_path       = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican_service_user.auth_section = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican_service_user.auth_type = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican_service_user.cafile   = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican_service_user.certfile = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican_service_user.collect_timing = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican_service_user.insecure = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican_service_user.keyfile  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican_service_user.split_loggers = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican_service_user.timeout  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican_service_user.tls_ciphers = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] barbican_service_user.tls_min_version = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.approle_role_id          = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.approle_secret_id        = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.auth_method              = approle {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.auth_path                = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.kv_mountpoint            = secret {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.kv_path                  = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.kv_version               = 2 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.namespace                = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.root_token_id            = **** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.ssl_ca_crt_file          = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.timeout                  = 60.0 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.token_file               = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.token_role               = None {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.use_ssl                  = False {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 29 18:14:10 devstack cinder-volume[86510]: DEBUG oslo_service.backend._eventlet.service [None req-b28a4374-fac9-4cd9-b035-d4c0e0fdd184 None None] ******************************************************************************** {{(pid=86510) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 29 18:14:10 devstack sudo[86824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:14:10 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:14:10 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.245s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:14:10 devstack cinder-volume[86821]: INFO cinder.volume.driver [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Driver hasn't implemented _init_vendor_properties()
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG cinder.volume.driver [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.014518737793, 'free_capacity_gb': 1775.014518737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86821) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_db.sqlalchemy.engines [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86821) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writer thread running {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG cinder.db.api [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Building query based on filter {{(pid=86821) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86821) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:14:10 devstack cinder-volume[86821]: INFO cinder.keymgr.migration [None req-51993180-23c5-4d41-89a2-1d434445c0fc None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 29 18:14:10 devstack sudo[86850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:14:10 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:14:10 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.252s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:14:10 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:14:11 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Driver initialization completed successfully.
Sep 29 18:14:11 devstack cinder-volume[86821]: INFO cinder.manager [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Initiating service 3 cleanup
Sep 29 18:14:11 devstack cinder-volume[86821]: INFO cinder.manager [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Service 3 cleanup completed.
Sep 29 18:14:11 devstack cinder-volume[86821]: DEBUG cinder.service [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Creating RPC server for service cinder-volume {{(pid=86821) start /opt/stack/cinder/cinder/service.py:231}}
Sep 29 18:14:11 devstack cinder-volume[86821]: DEBUG cinder.service [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86821) start /opt/stack/cinder/cinder/service.py:237}}
Sep 29 18:14:11 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 29 18:14:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:14:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:14:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:14:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:14:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:14:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:14:11 devstack sudo[86884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:14:11 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:14:11 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root
Sep 29 18:14:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.257s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:14:11 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fc924430-ce09-4073-bde9-0c12ce1ef28c None None] Driver post RPC initialization completed successfully.
Sep 29 18:14:19 devstack cinder-volume[86510]: DEBUG dbcounter [-] [86510] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:14:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=3 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:14:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:14:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:14:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 6 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:14:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Flow 'volume_create_manager' (f9d5e109-1768-41cd-aded-0b4720688c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fcf048-9e50-495e-a512-7b7e2c7c2227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fcf048-9e50-495e-a512-7b7e2c7c2227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1468176414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1563ddcb-4452-47cf-b534-34967ed6c8a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f5d94b633a543878c618212dcc212eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:09Z,use_quota=True,user_id='b52135d788e1432594dfd4911afbe992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd58973-7d65-4c3f-9c8b-5210cb46552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd58973-7d65-4c3f-9c8b-5210cb46552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946f8588-b22a-48e8-9e13-42ff15e01ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946f8588-b22a-48e8-9e13-42ff15e01ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1563ddcb-4452-47cf-b534-34967ed6c8a5', 'volume_name': 'volume-1563ddcb-4452-47cf-b534-34967ed6c8a5', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aafe3c9-c204-4f9c-a5ef-3a2a3b12baa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aafe3c9-c204-4f9c-a5ef-3a2a3b12baa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84c0337-06c9-446c-ab44-d1884e725eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:09 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Volume 1563ddcb-4452-47cf-b534-34967ed6c8a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1563ddcb-4452-47cf-b534-34967ed6c8a5', 'volume_size': 1}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1468176414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1563ddcb-4452-47cf-b534-34967ed6c8a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f5d94b633a543878c618212dcc212eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:09Z,use_quota=True,user_id='b52135d788e1432594dfd4911afbe992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Creating volume 1563ddcb-4452-47cf-b534-34967ed6c8a5 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:15:09 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:09 devstack sudo[87125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5 1073741824
Sep 29 18:15:09 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Flow 'volume_create_manager' (7a0a0a3f-4ffc-4a7d-9977-f1355803a0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e2a491-4984-45f2-a8c2-cc5d2bcbc39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e2a491-4984-45f2-a8c2-cc5d2bcbc39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-599912056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c89110e-ee62-41ee-934b-3b6395539a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5505bd92b7d743348e6b8747c228650c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:09Z,use_quota=True,user_id='ce54dca8c2b9475ba3be97b73d0000cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb1c685-5249-414e-a4b5-4aa320c7d3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb1c685-5249-414e-a4b5-4aa320c7d3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e054c9-56e0-4dbf-b8fe-bfce7d420a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e054c9-56e0-4dbf-b8fe-bfce7d420a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c89110e-ee62-41ee-934b-3b6395539a45', 'volume_name': 'volume-4c89110e-ee62-41ee-934b-3b6395539a45', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9af1488-ca21-4a18-b2ad-16f93507f9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9af1488-ca21-4a18-b2ad-16f93507f9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b4b171-50c5-4e9c-8d7f-294b951a4ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:09 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Volume 4c89110e-ee62-41ee-934b-3b6395539a45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c89110e-ee62-41ee-934b-3b6395539a45', 'volume_size': 1}
Sep 29 18:15:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:10 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5 1073741824" returned: 0 in 0.653s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:10 devstack sudo[87443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5
Sep 29 18:15:10 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:10 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5" returned: 0 in 0.263s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-599912056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c89110e-ee62-41ee-934b-3b6395539a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5505bd92b7d743348e6b8747c228650c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:09Z,use_quota=True,user_id='ce54dca8c2b9475ba3be97b73d0000cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Creating volume 4c89110e-ee62-41ee-934b-3b6395539a45 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:15:10 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:10 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45 1073741824
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84c0337-06c9-446c-ab44-d1884e725eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1563ddcb-4452-47cf-b534-34967ed6c8a5', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:10 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cabbc1f-9d10-4aba-bece-bedd4499eba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:10 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Volume volume-1563ddcb-4452-47cf-b534-34967ed6c8a5 (1563ddcb-4452-47cf-b534-34967ed6c8a5): created successfully
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cabbc1f-9d10-4aba-bece-bedd4499eba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Flow 'volume_create_manager' (f9d5e109-1768-41cd-aded-0b4720688c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:10 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ccb19ac4-0c68-4b92-a171-dc48f703b41b tempest-VolumesTestJSON-2122665135 None] Created volume successfully.
Sep 29 18:15:11 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45 1073741824" returned: 0 in 0.449s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:11 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45
Sep 29 18:15:11 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:11 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45" returned: 0 in 0.354s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:15:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b4b171-50c5-4e9c-8d7f-294b951a4ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c89110e-ee62-41ee-934b-3b6395539a45', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a71810-3088-456e-a7af-462b76873a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:11 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Volume volume-4c89110e-ee62-41ee-934b-3b6395539a45 (4c89110e-ee62-41ee-934b-3b6395539a45): created successfully
Sep 29 18:15:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a71810-3088-456e-a7af-462b76873a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Flow 'volume_create_manager' (7a0a0a3f-4ffc-4a7d-9977-f1355803a0a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:11 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-04cc05e5-5125-48f3-9b0a-45ca38526fdb tempest-TaggedAttachmentsTest-871449363 None] Created volume successfully.
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Flow 'volume_create_manager' (a3ebb23e-f7e9-4fff-822f-93592943c5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b6fa56-54b7-4dc0-a751-6e21552ec55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b6fa56-54b7-4dc0-a751-6e21552ec55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1832399253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ee9ecc-72cf-4bf3-ab96-f126b3044e83,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f5d94b633a543878c618212dcc212eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:13Z,use_quota=True,user_id='b52135d788e1432594dfd4911afbe992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d042d29b-bfa5-44e5-861e-1daf22b9e621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d042d29b-bfa5-44e5-861e-1daf22b9e621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3a2e2e-c35f-493b-a76d-a9e6884473ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3a2e2e-c35f-493b-a76d-a9e6884473ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ee9ecc-72cf-4bf3-ab96-f126b3044e83', 'volume_name': 'volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107103f3-e238-4444-b2e8-78152f80e768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107103f3-e238-4444-b2e8-78152f80e768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c39f20f-a509-4a87-bead-d541ab3ab4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:13 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Volume 84ee9ecc-72cf-4bf3-ab96-f126b3044e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83', 'volume_size': 1}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1832399253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ee9ecc-72cf-4bf3-ab96-f126b3044e83,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f5d94b633a543878c618212dcc212eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:13Z,use_quota=True,user_id='b52135d788e1432594dfd4911afbe992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Creating volume 84ee9ecc-72cf-4bf3-ab96-f126b3044e83 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:15:13 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:13 devstack sudo[87496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83 1073741824
Sep 29 18:15:13 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:13 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83 1073741824" returned: 0 in 0.642s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:14 devstack sudo[87502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83
Sep 29 18:15:14 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:14 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83" returned: 0 in 0.381s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:15:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c39f20f-a509-4a87-bead-d541ab3ab4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b389c0b-6cbb-4566-92c7-da1775d1f724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:14 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Volume volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83 (84ee9ecc-72cf-4bf3-ab96-f126b3044e83): created successfully
Sep 29 18:15:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b389c0b-6cbb-4566-92c7-da1775d1f724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Flow 'volume_create_manager' (a3ebb23e-f7e9-4fff-822f-93592943c5ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:14 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-187c3d1a-2f23-4f87-a30c-b33737ff509d tempest-VolumesTestJSON-2122665135 None] Created volume successfully.
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Flow 'volume_create_manager' (f93e708e-78a9-40ef-b43b-012ed03290e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397dd6f8-6c59-405b-868f-e72b746de10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397dd6f8-6c59-405b-868f-e72b746de10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1402693853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2e2428-3935-44a2-bd0d-3260ccffd71a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f5d94b633a543878c618212dcc212eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:16Z,use_quota=True,user_id='b52135d788e1432594dfd4911afbe992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2847a0-f8df-4db4-9edf-b383ece16aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2847a0-f8df-4db4-9edf-b383ece16aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517a41b0-799e-490f-9815-856e6b58b1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517a41b0-799e-490f-9815-856e6b58b1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2e2428-3935-44a2-bd0d-3260ccffd71a', 'volume_name': 'volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b54e52-8219-4a70-8501-299d8a5e33c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b54e52-8219-4a70-8501-299d8a5e33c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259fee23-2afc-4d6c-a5fa-3180e9bf8fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:16 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Volume cc2e2428-3935-44a2-bd0d-3260ccffd71a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a', 'volume_size': 1}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1402693853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2e2428-3935-44a2-bd0d-3260ccffd71a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f5d94b633a543878c618212dcc212eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:16Z,use_quota=True,user_id='b52135d788e1432594dfd4911afbe992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Creating volume cc2e2428-3935-44a2-bd0d-3260ccffd71a {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:15:16 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:16 devstack sudo[87508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a 1073741824
Sep 29 18:15:16 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:16 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a 1073741824" returned: 0 in 0.562s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:16 devstack sudo[87516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a
Sep 29 18:15:16 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:17 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a" returned: 0 in 0.247s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:15:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259fee23-2afc-4d6c-a5fa-3180e9bf8fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5821404-014f-4792-acb1-feeeb97bcb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:17 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Volume volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a (cc2e2428-3935-44a2-bd0d-3260ccffd71a): created successfully
Sep 29 18:15:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5821404-014f-4792-acb1-feeeb97bcb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Flow 'volume_create_manager' (f93e708e-78a9-40ef-b43b-012ed03290e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:17 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-70c91004-fa3f-41df-a3a1-93a1312ca9bb tempest-VolumesTestJSON-2122665135 None] Created volume successfully.
Sep 29 18:15:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Acquiring lock "cinder-cc2e2428-3935-44a2-bd0d-3260ccffd71a-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:15:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-cc2e2428-3935-44a2-bd0d-3260ccffd71a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:15:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Acquiring lock "cinder-quobyte-cc2e2428-3935-44a2-bd0d-3260ccffd71a" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:15:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-quobyte-cc2e2428-3935-44a2-bd0d-3260ccffd71a" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:15:19 devstack cinder-volume[86821]: INFO oslo.privsep.daemon [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpoajjiz57/privsep.sock']
Sep 29 18:15:19 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpoajjiz57/privsep.sock
Sep 29 18:15:19 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:20 devstack cinder-volume[86821]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 29 18:15:20 devstack cinder-volume[86821]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 29 18:15:20 devstack cinder-volume[86821]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 29 18:15:20 devstack cinder-volume[86821]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 29 18:15:20 devstack cinder-volume[86821]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 29 18:15:20 devstack cinder-volume[86821]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 29 18:15:20 devstack cinder-volume[86821]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 29 18:15:20 devstack cinder-volume[86821]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 29 18:15:20 devstack cinder-volume[86821]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 29 18:15:21 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:21 devstack cinder-volume[86821]: INFO oslo.privsep.daemon [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Spawned new privsep daemon via rootwrap
Sep 29 18:15:21 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Accepted privsep connection to /tmp/tmpoajjiz57/privsep.sock {{(pid=86821) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 29 18:15:21 devstack cinder-volume[86821]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 29 18:15:21 devstack cinder-volume[86821]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 29 18:15:21 devstack cinder-volume[86821]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 29 18:15:21 devstack cinder-volume[86821]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87597
Sep 29 18:15:21 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6ad57a-c33f-48cf-a0b8-4c9a8b6a7cc2]: (2,) {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:15:21 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[af43a7ac-5460-4b8b-86ee-c4bfd947db69]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:15:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:21 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a
Sep 29 18:15:21 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:21 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a" returned: 0 in 0.604s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:21 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a
Sep 29 18:15:21 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:22 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cc2e2428-3935-44a2-bd0d-3260ccffd71a" returned: 0 in 0.330s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-quobyte-cc2e2428-3935-44a2-bd0d-3260ccffd71a" released by "delete_volume" :: held 2.529s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:15:22 devstack cinder-volume[86821]: WARNING cinder.quota [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:15:22 devstack cinder-volume[86821]: WARNING cinder.quota [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Created reservations ['d744cc83-d9e3-4826-bf02-137ec6786b9c', '2c351946-9fa3-4e32-b129-e90c015f7814', '49bab5fc-01f5-4f19-9ca1-23b4b19192fe', 'aa74eddf-c911-46dc-8777-057d15372e66'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:22 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:15:22 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:22 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.269s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:15:22 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Deleted volume successfully.
Sep 29 18:15:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-00e45ddf-e0b5-4af5-ac82-88def59c4ab3 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-cc2e2428-3935-44a2-bd0d-3260ccffd71a-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:15:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Acquiring lock "cinder-84ee9ecc-72cf-4bf3-ab96-f126b3044e83-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:15:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-84ee9ecc-72cf-4bf3-ab96-f126b3044e83-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:15:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Acquiring lock "cinder-quobyte-84ee9ecc-72cf-4bf3-ab96-f126b3044e83" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:15:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-quobyte-84ee9ecc-72cf-4bf3-ab96-f126b3044e83" acquired by "delete_volume" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:15:23 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[038fe36a-7c9d-4bee-ac6a-85dca9f31001]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:15:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:23 devstack sudo[87643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83
Sep 29 18:15:23 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:23 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83" returned: 0 in 0.495s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:24 devstack sudo[87649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83
Sep 29 18:15:24 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:24 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-84ee9ecc-72cf-4bf3-ab96-f126b3044e83" returned: 0 in 0.316s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-quobyte-84ee9ecc-72cf-4bf3-ab96-f126b3044e83" released by "delete_volume" :: held 0.885s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Created reservations ['7a0d0fd3-5caf-44a6-9581-767378359fa3', 'dbbe262a-29f9-42c6-be7a-1ac351b7cc85', 'ac8c2459-52fa-4a6a-991d-8f62d9572367', '6d816f73-024e-4312-8a11-eca5ee6f4bbf'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:24 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:15:24 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Acquiring lock "cinder-1563ddcb-4452-47cf-b534-34967ed6c8a5-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-1563ddcb-4452-47cf-b534-34967ed6c8a5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Acquiring lock "cinder-quobyte-1563ddcb-4452-47cf-b534-34967ed6c8a5" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-quobyte-1563ddcb-4452-47cf-b534-34967ed6c8a5" acquired by "delete_volume" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:15:24 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.341s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:15:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Deleted volume successfully.
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4353e0ee-aa84-4361-96be-e7713d22c305]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a01f2ef6-28ee-49e1-af13-fe5724215df0 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-84ee9ecc-72cf-4bf3-ab96-f126b3044e83-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:15:25 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5
Sep 29 18:15:25 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:25 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5" returned: 0 in 0.622s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:25 devstack sudo[87680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5
Sep 29 18:15:25 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:25 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1563ddcb-4452-47cf-b534-34967ed6c8a5" returned: 0 in 0.369s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-quobyte-1563ddcb-4452-47cf-b534-34967ed6c8a5" released by "delete_volume" :: held 1.075s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:15:26 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Created reservations ['8b0adf10-b51f-4416-b422-ef11d4e0af1a', '3b7e393c-966a-4775-86b3-ee2b2c8568f2', 'ab495916-3c94-4076-9619-cc2c21146a78', 'b09a6199-f265-474e-94a2-dbdb5d8c356a'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:15:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:15:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:15:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:26 devstack sudo[87705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:15:26 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:26 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.333s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:26 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:15:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Deleted volume successfully.
Sep 29 18:15:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6a9c27a-1f00-4c29-bad5-f2e86dfec2e7 tempest-VolumesTestJSON-2122665135 None] Lock "cinder-1563ddcb-4452-47cf-b534-34967ed6c8a5-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:15:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-29a16d7d-6753-4316-961a-70de15c734d4 tempest-BackendsCapabilitiesAdminTestsJSON-1688353926 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.014518737793, 'free_capacity_gb': 1775.014518737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86821) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 29 18:15:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dadc3c66-2075-4117-9f2f-c91b96300b9e tempest-BackendsCapabilitiesAdminTestsJSON-1688353926 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.014518737793, 'free_capacity_gb': 1775.014518737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86821) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=22,cinder:UPDATE=39,cinder:DELETE=4,cinder:INSERT=9 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=24,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Flow 'volume_create_manager' (c41ac62b-be73-44a3-87d4-6ee55167302b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa92a55a-0f3e-42b1-9c44-6e836b9f92bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa92a55a-0f3e-42b1-9c44-6e836b9f92bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1181903501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2d10d6-343c-45c7-abc7-543e570a9eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4860745810c4a7592d69ec4fa115c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:37Z,use_quota=True,user_id='42122e5c927e49c8987264effd143754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b8fd4f-47a8-43ab-92db-d320f5d1362b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b8fd4f-47a8-43ab-92db-d320f5d1362b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1802a1-cf54-4f86-bc8a-cfa2186300d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1802a1-cf54-4f86-bc8a-cfa2186300d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf2d10d6-343c-45c7-abc7-543e570a9eba', 'volume_name': 'volume-bf2d10d6-343c-45c7-abc7-543e570a9eba', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cca8f94-da28-4a49-8ec6-3c671cb680e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cca8f94-da28-4a49-8ec6-3c671cb680e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2cd289-4ab3-478d-a168-d357068fba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:36 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Volume bf2d10d6-343c-45c7-abc7-543e570a9eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf2d10d6-343c-45c7-abc7-543e570a9eba', 'volume_size': 1}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1181903501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2d10d6-343c-45c7-abc7-543e570a9eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4860745810c4a7592d69ec4fa115c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:37Z,use_quota=True,user_id='42122e5c927e49c8987264effd143754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Creating volume bf2d10d6-343c-45c7-abc7-543e570a9eba {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:15:36 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:15:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:36 devstack sudo[87907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba 1073741824
Sep 29 18:15:36 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:37 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba 1073741824" returned: 0 in 1.079s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:38 devstack sudo[87912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba
Sep 29 18:15:38 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:38 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba" returned: 0 in 0.668s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:15:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2cd289-4ab3-478d-a168-d357068fba5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf2d10d6-343c-45c7-abc7-543e570a9eba', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c7321a-7e20-4a01-a74f-86c1f9ad724c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:38 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Volume volume-bf2d10d6-343c-45c7-abc7-543e570a9eba (bf2d10d6-343c-45c7-abc7-543e570a9eba): created successfully
Sep 29 18:15:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c7321a-7e20-4a01-a74f-86c1f9ad724c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Flow 'volume_create_manager' (c41ac62b-be73-44a3-87d4-6ee55167302b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:38 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-da857039-91db-4e42-a914-61262054c339 tempest-VolumesAdminNegativeTest-1746264997 None] Created volume successfully.
Sep 29 18:15:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Acquiring lock "cinder-bf2d10d6-343c-45c7-abc7-543e570a9eba-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:15:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Lock "cinder-bf2d10d6-343c-45c7-abc7-543e570a9eba-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:15:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Acquiring lock "cinder-quobyte-bf2d10d6-343c-45c7-abc7-543e570a9eba" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:15:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Lock "cinder-quobyte-bf2d10d6-343c-45c7-abc7-543e570a9eba" acquired by "delete_volume" :: waited 0.069s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:15:41 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a36b5-8ce4-4ce1-9a0b-f0238e939b8e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:15:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:41 devstack sudo[87977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba
Sep 29 18:15:41 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:42 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba" returned: 0 in 0.929s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:42 devstack sudo[87996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba
Sep 29 18:15:42 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:43 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bf2d10d6-343c-45c7-abc7-543e570a9eba" returned: 0 in 0.789s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Lock "cinder-quobyte-bf2d10d6-343c-45c7-abc7-543e570a9eba" released by "delete_volume" :: held 1.851s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:15:43 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Created reservations ['c0404300-737b-4e61-b8ff-d5940f0f357e', '03c33e5c-17d2-4cbe-9ad4-d1c29d0b1bdc', '5f4411dd-aee0-4c66-a48e-5c7a68551c61', '28096485-2480-4a64-b9ba-2f6d6a504e5e'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:15:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:15:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:15:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:43 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:15:43 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:44 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.712s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:44 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:15:44 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Deleted volume successfully.
Sep 29 18:15:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e868f155-0100-495e-b8f0-e5ae23a54968 tempest-VolumesAdminNegativeTest-1746264997 None] Lock "cinder-bf2d10d6-343c-45c7-abc7-543e570a9eba-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:15:53 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:54 devstack sudo[88114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:15:54 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-50d82093-1ce5-4dc1-be74-af1cb4c4eb71 tempest-GroupSnapshotsTest-402769389 None] Group tempest-GroupSnapshotsTest-Group-1423897480: creating
Sep 29 18:15:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-50d82093-1ce5-4dc1-be74-af1cb4c4eb71 tempest-GroupSnapshotsTest-402769389 None] Group tempest-GroupSnapshotsTest-Group-1423897480: created successfully
Sep 29 18:15:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-50d82093-1ce5-4dc1-be74-af1cb4c4eb71 tempest-GroupSnapshotsTest-402769389 None] Create group completed successfully.
Sep 29 18:15:54 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.558s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 8 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:15:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Flow 'volume_create_manager' (62090539-499e-4424-978d-c5a49efb07bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb10197-30e0-4050-989c-a4738cba70c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb10197-30e0-4050-989c-a4738cba70c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-820627184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8bf5de66-ca77-41bc-becf-4069109f874c,host='devstack@QuobyteHD#QuobyteHD',id=e33e1b33-32e3-4f61-8eb0-5abf96453892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee26bd6875db44e1b2f8b0f7651364fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:57Z,use_quota=True,user_id='9d85d117c8de4a249101317c90baf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(792d74e4-3fb1-46bb-abe5-4daf6a6c1621),volume_type_id=792d74e4-3fb1-46bb-abe5-4daf6a6c1621)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eadff14-85b9-440f-aeb9-4d6d8cda6a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eadff14-85b9-440f-aeb9-4d6d8cda6a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6055c7d9-4b8b-4a24-8f7c-9c0dc3458d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6055c7d9-4b8b-4a24-8f7c-9c0dc3458d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e33e1b33-32e3-4f61-8eb0-5abf96453892', 'volume_name': 'volume-e33e1b33-32e3-4f61-8eb0-5abf96453892', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf47294-e6af-4cbd-bc2e-bbe7608c62a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf47294-e6af-4cbd-bc2e-bbe7608c62a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8744a2-6bed-4dba-b833-03ae77570958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:57 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Volume e33e1b33-32e3-4f61-8eb0-5abf96453892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e33e1b33-32e3-4f61-8eb0-5abf96453892', 'volume_size': 1}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8bf5de66-ca77-41bc-becf-4069109f874c,created_at=2026-09-29T16:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-820627184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8bf5de66-ca77-41bc-becf-4069109f874c,host='devstack@QuobyteHD#QuobyteHD',id=e33e1b33-32e3-4f61-8eb0-5abf96453892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee26bd6875db44e1b2f8b0f7651364fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:15:57Z,use_quota=True,user_id='9d85d117c8de4a249101317c90baf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(792d74e4-3fb1-46bb-abe5-4daf6a6c1621),volume_type_id=792d74e4-3fb1-46bb-abe5-4daf6a6c1621)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Creating volume e33e1b33-32e3-4f61-8eb0-5abf96453892 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:15:57 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:57 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 1073741824
Sep 29 18:15:57 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:57 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 1073741824" returned: 0 in 0.563s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:15:57 devstack sudo[88210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892
Sep 29 18:15:57 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:15:58 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root
Sep 29 18:15:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892" returned: 0 in 0.353s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:15:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:15:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:15:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8744a2-6bed-4dba-b833-03ae77570958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e33e1b33-32e3-4f61-8eb0-5abf96453892', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e6a238-89dc-4a5c-9642-697fed59ea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:15:58 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Volume volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 (e33e1b33-32e3-4f61-8eb0-5abf96453892): created successfully
Sep 29 18:15:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e6a238-89dc-4a5c-9642-697fed59ea6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:15:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Flow 'volume_create_manager' (62090539-499e-4424-978d-c5a49efb07bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:15:58 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bdc8a609-9836-4c2b-a475-f26ecc8781c8 tempest-GroupSnapshotsTest-402769389 None] Created volume successfully.
Sep 29 18:16:00 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] GroupSnapshot 80027f25-cb2a-43ad-aba9-a2d1786f87f9: creating.
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] Group snapshot 80027f25-cb2a-43ad-aba9-a2d1786f87f9: creating. {{(pid=86821) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] Creating offline snapshot 8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd of volume e33e1b33-32e3-4f61-8eb0-5abf96453892 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b7f862-9807-4eec-b5d8-7358e8f69124]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Flow 'volume_create_manager' (50ccfa25-82e5-452d-8316-74811c20eed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15311731-3f48-4ccd-be25-b91d984eda64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:00 devstack sudo[88218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892
Sep 29 18:16:00 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15311731-3f48-4ccd-be25-b91d984eda64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1944652896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda4dfa0-d14f-4a1d-a04c-dc218bab4654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d0896f3e954f518f96361a13bdcdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:16:00Z,use_quota=True,user_id='0d512bfa6dd14e67bd0793a6b59f6bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec8fea0-0cec-4594-b3af-205414ed6360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec8fea0-0cec-4594-b3af-205414ed6360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2145c2-5285-46e8-952d-760c3ead136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2145c2-5285-46e8-952d-760c3ead136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda4dfa0-d14f-4a1d-a04c-dc218bab4654', 'volume_name': 'volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78288be0-c00f-48cd-868b-945c0ac59755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78288be0-c00f-48cd-868b-945c0ac59755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d94aa5e-4844-49ff-90e1-7f58209c3eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:00 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Volume fda4dfa0-d14f-4a1d-a04c-dc218bab4654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654', 'volume_size': 1}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:00 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892" returned: 0 in 0.500s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:00 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd 1G
Sep 29 18:16:00 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:01 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd 1G" returned: 0 in 0.470s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:01 devstack sudo[88228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd
Sep 29 18:16:01 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:01 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd" returned: 0 in 0.303s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:01 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:16:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:01 devstack sudo[88233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd
Sep 29 18:16:01 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:01 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd" returned: 0 in 0.288s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:01 devstack sudo[88237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.info
Sep 29 18:16:01 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:02 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.info" returned: 0 in 0.475s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:02 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:02 devstack sudo[88240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.info
Sep 29 18:16:02 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:02 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.info" returned: 0 in 0.305s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.567s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.266s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1944652896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda4dfa0-d14f-4a1d-a04c-dc218bab4654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d0896f3e954f518f96361a13bdcdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:16:00Z,use_quota=True,user_id='0d512bfa6dd14e67bd0793a6b59f6bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Creating volume fda4dfa0-d14f-4a1d-a04c-dc218bab4654 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:16:02 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:16:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:02 devstack sudo[88243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654 1073741824
Sep 29 18:16:02 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:02 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e0d2109f-1cc5-4628-b21b-32c291499962 tempest-GroupSnapshotsTest-402769389 None] group_snapshot 80027f25-cb2a-43ad-aba9-a2d1786f87f9: created successfully
Sep 29 18:16:03 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654 1073741824" returned: 0 in 0.553s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:03 devstack sudo[88249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654
Sep 29 18:16:03 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:03 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654" returned: 0 in 0.328s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:16:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d94aa5e-4844-49ff-90e1-7f58209c3eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278c8d55-dba7-450b-800c-71b979a172d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:03 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Volume volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654 (fda4dfa0-d14f-4a1d-a04c-dc218bab4654): created successfully
Sep 29 18:16:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278c8d55-dba7-450b-800c-71b979a172d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Flow 'volume_create_manager' (50ccfa25-82e5-452d-8316-74811c20eed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:16:03 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8abdcf2d-7be4-436b-84ee-53adf1cdb45e tempest-DeleteServersTestJSON-988911967 None] Created volume successfully.
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd-06e5a29f-d3e8-484b-acb2-47a81af360ce" by "_create_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd-06e5a29f-d3e8-484b-acb2-47a81af360ce" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Creating volume 06e5a29f-d3e8-484b-acb2-47a81af360ce from snapshot 8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd {{(pid=86821) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-06e5a29f-d3e8-484b-acb2-47a81af360ce" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-06e5a29f-d3e8-484b-acb2-47a81af360ce" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] snapshot: 8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd, volume: 06e5a29f-d3e8-484b-acb2-47a81af360ce,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1dac30-7f9f-4f06-b0c5-e0d21a311993]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:04 devstack sudo[88253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd
Sep 29 18:16:04 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:05 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd" returned: 0 in 0.591s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e33e1b33-32e3-4f61-8eb0-5abf96453892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:16:05 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c0fb8e-7882-4d58-a719-2e4637b5f70a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:05 devstack sudo[88267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892
Sep 29 18:16:05 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:05 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892" returned: 0 in 0.566s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:16:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:16:05 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:16:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:05 devstack sudo[88273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce
Sep 29 18:16:05 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:12 devstack cinder-volume[86821]: WARNING py.warnings [req-5b0f8d7f-2b11-4a27-94a6-c5726bee64ba req-6bb09962-c8a3-4da8-962f-be6af35b29a8 tempest-DeleteServersTestJSON-988911967 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Sep 29 18:16:12 devstack cinder-volume[86821]:   .first()
Sep 29 18:16:12 devstack cinder-volume[86821]: 
Sep 29 18:16:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-5b0f8d7f-2b11-4a27-94a6-c5726bee64ba req-6bb09962-c8a3-4da8-962f-be6af35b29a8 tempest-DeleteServersTestJSON-988911967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:17 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce" returned: 0 in 11.636s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:17 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892, size 1024.00 MB, duration 11.64 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:16:17 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Converted 1024.00 MB image at 87.99 MB/s
Sep 29 18:16:17 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:16:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:17 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce
Sep 29 18:16:17 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:17 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce" returned: 0 in 0.356s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-06e5a29f-d3e8-484b-acb2-47a81af360ce" released by "_copy_volume_from_snapshot" :: held 13.307s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd-06e5a29f-d3e8-484b-acb2-47a81af360ce" released by "_create_volume_from_snapshot" :: held 13.405s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.451s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-5b0f8d7f-2b11-4a27-94a6-c5726bee64ba req-6bb09962-c8a3-4da8-962f-be6af35b29a8 tempest-DeleteServersTestJSON-988911967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.562s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-5b0f8d7f-2b11-4a27-94a6-c5726bee64ba req-6bb09962-c8a3-4da8-962f-be6af35b29a8 tempest-DeleteServersTestJSON-988911967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-5b0f8d7f-2b11-4a27-94a6-c5726bee64ba req-6bb09962-c8a3-4da8-962f-be6af35b29a8 tempest-DeleteServersTestJSON-988911967 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2f51862-f8ad-4cb9-9a0b-ce979b50ec09', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:16:18 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fa4e53b3-d104-473e-a082-02c7703af323 tempest-GroupSnapshotsTest-402769389 None] Create group from source-snapshot-80027f25-cb2a-43ad-aba9-a2d1786f87f9 completed successfully.
Sep 29 18:16:18 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-5b0f8d7f-2b11-4a27-94a6-c5726bee64ba req-6bb09962-c8a3-4da8-962f-be6af35b29a8 tempest-DeleteServersTestJSON-988911967 None] attachment_update completed successfully.
Sep 29 18:16:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-06e5a29f-d3e8-484b-acb2-47a81af360ce" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-06e5a29f-d3e8-484b-acb2-47a81af360ce" acquired by "delete_volume" :: waited 0.038s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:18 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1bb55f-fd89-4e03-8125-4604a4068a3f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:18 devstack sudo[88873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce
Sep 29 18:16:18 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:19 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce" returned: 0 in 0.632s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:19 devstack sudo[88889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce
Sep 29 18:16:19 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-d8a8c844-82e4-4661-80e5-63070ce4cce3 req-a2d90be5-b92d-4c28-80a4-adba1855057b tempest-TaggedAttachmentsTest-871449363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-d8a8c844-82e4-4661-80e5-63070ce4cce3 req-a2d90be5-b92d-4c28-80a4-adba1855057b tempest-TaggedAttachmentsTest-871449363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-d8a8c844-82e4-4661-80e5-63070ce4cce3 req-a2d90be5-b92d-4c28-80a4-adba1855057b tempest-TaggedAttachmentsTest-871449363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-d8a8c844-82e4-4661-80e5-63070ce4cce3 req-a2d90be5-b92d-4c28-80a4-adba1855057b tempest-TaggedAttachmentsTest-871449363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-4c89110e-ee62-41ee-934b-3b6395539a45', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f1de50e-6bcd-4cb9-ae86-fabfb2b339b9', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:16:19 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-06e5a29f-d3e8-484b-acb2-47a81af360ce" returned: 0 in 0.379s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-06e5a29f-d3e8-484b-acb2-47a81af360ce" released by "delete_volume" :: held 1.077s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:19 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-d8a8c844-82e4-4661-80e5-63070ce4cce3 req-a2d90be5-b92d-4c28-80a4-adba1855057b tempest-TaggedAttachmentsTest-871449363 None] attachment_update completed successfully.
Sep 29 18:16:19 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['abdd7114-e540-4fed-804c-2c3aef105e65'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:19 devstack cinder-volume[86821]: WARNING cinder.quota [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-649802435 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-649802435, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:16:19 devstack cinder-volume[86821]: WARNING cinder.quota [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-649802435 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-649802435, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:16:19 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['2a9d0e0a-a502-4a3a-9139-db4a4e0c2109', '1ba5e89d-fdb1-4430-8c0a-7cb189c57849', '606641be-67c0-4149-96d3-bc68a74ef75c', '0fc9910e-fd94-46f6-b210-01ab55cb29e8'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:20 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:16:20 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:20 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.357s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:20 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:16:20 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ed5a01c1-0547-4071-9ec9-bb92dc5494f5 tempest-GroupSnapshotsTest-402769389 None] Delete group completed successfully.
Sep 29 18:16:21 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] group_snapshot 80027f25-cb2a-43ad-aba9-a2d1786f87f9: deleting
Sep 29 18:16:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] group_snapshot 80027f25-cb2a-43ad-aba9-a2d1786f87f9: deleting {{(pid=86821) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 18:16:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-e33e1b33-32e3-4f61-8eb0-5abf96453892" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-e33e1b33-32e3-4f61-8eb0-5abf96453892" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Deleting offline snapshot 8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd of volume e33e1b33-32e3-4f61-8eb0-5abf96453892 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:16:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] snapshot_file for this snap is: volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:16:21 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f888286-8c2d-4b66-955e-9ec642255c8e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:21 devstack sudo[88926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd
Sep 29 18:16:21 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:22 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd" returned: 0 in 0.654s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e33e1b33-32e3-4f61-8eb0-5abf96453892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:16:22 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27cd919-c0e9-4b3a-b193-85d093785162]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:22 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892
Sep 29 18:16:22 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:23 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-aea6c93c-acaf-4c71-9db4-4987ddc54af6 req-d2b6e691-09ae-4b57-a0ef-c9a749e13a97 tempest-DeleteServersTestJSON-988911967 None] Terminate volume connection completed successfully.
Sep 29 18:16:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-aea6c93c-acaf-4c71-9db4-4987ddc54af6 req-d2b6e691-09ae-4b57-a0ef-c9a749e13a97 tempest-DeleteServersTestJSON-988911967 None] Deleting attachment d2f51862-f8ad-4cb9-9a0b-ce979b50ec09. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:16:23 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892" returned: 0 in 0.800s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:23 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd
Sep 29 18:16:23 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:23 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd" returned: 0 in 0.526s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:23 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd
Sep 29 18:16:23 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:24 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892.8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd" returned: 0 in 0.355s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-8ee96f1a-c5bf-4693-aa48-bfa17e9bf7fd" released by "_delete_snapshot" :: held 2.583s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-e33e1b33-32e3-4f61-8eb0-5abf96453892" released by "delete_snapshot" :: held 2.616s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:24 devstack cinder-volume[86821]: WARNING cinder.quota [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-649802435 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-649802435, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:16:24 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['fb74e4a0-941a-4a6c-8dd9-aef150834c1a', '6b718674-9262-4569-9dc6-103af0a580e1', 'ee4ac816-3b2d-4977-8b12-d9283eb64bda', 'c3067daa-ec18-4aa5-82ac-1b002c2cf302'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fa95401d-98ac-4968-b11f-103d47f780a6 tempest-GroupSnapshotsTest-402769389 None] group_snapshot 80027f25-cb2a-43ad-aba9-a2d1786f87f9: deleted successfully
Sep 29 18:16:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Acquiring lock "cinder-fda4dfa0-d14f-4a1d-a04c-dc218bab4654-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Lock "cinder-fda4dfa0-d14f-4a1d-a04c-dc218bab4654-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Acquiring lock "cinder-quobyte-fda4dfa0-d14f-4a1d-a04c-dc218bab4654" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-b030f6d1-4de7-42ed-aa38-543ed0a3dcca req-0b4193bf-deb4-4bf2-bbef-f3da70dbe097 tempest-TaggedAttachmentsTest-871449363 None] Terminate volume connection completed successfully.
Sep 29 18:16:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-b030f6d1-4de7-42ed-aa38-543ed0a3dcca req-0b4193bf-deb4-4bf2-bbef-f3da70dbe097 tempest-TaggedAttachmentsTest-871449363 None] Deleting attachment 7f1de50e-6bcd-4cb9-ae86-fabfb2b339b9. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:16:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Lock "cinder-quobyte-fda4dfa0-d14f-4a1d-a04c-dc218bab4654" acquired by "delete_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:24 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b136e8-1ec1-44c5-ba6e-e208c32be565]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:24 devstack sudo[88992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654
Sep 29 18:16:24 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-e33e1b33-32e3-4f61-8eb0-5abf96453892" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-e33e1b33-32e3-4f61-8eb0-5abf96453892" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:25 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[499eabf9-8354-4255-88c9-eab437986d8b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654" returned: 0 in 0.633s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:25 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:25 devstack sudo[88998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892
Sep 29 18:16:25 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:25 devstack sudo[88999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654
Sep 29 18:16:25 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:25 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fda4dfa0-d14f-4a1d-a04c-dc218bab4654" returned: 0 in 0.568s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Lock "cinder-quobyte-fda4dfa0-d14f-4a1d-a04c-dc218bab4654" released by "delete_volume" :: held 1.267s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:26 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892" returned: 0 in 0.706s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:26 devstack sudo[89023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892
Sep 29 18:16:26 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Created reservations ['8c49c18b-a3bb-4c9a-8250-d43e0cf45464', 'ba3f9a56-9828-4c22-9ede-a50276e68071', '6ac17c3d-cce0-40e2-a7f1-61cd83e447f7', '68054d33-4510-48d5-a98b-27676c696682'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:26 devstack sudo[89025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:16:26 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:26 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e33e1b33-32e3-4f61-8eb0-5abf96453892" returned: 0 in 0.367s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-e33e1b33-32e3-4f61-8eb0-5abf96453892" released by "delete_volume" :: held 1.191s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['1f375003-664f-4e5f-bf44-ca0c2dbee0a6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:26 devstack cinder-volume[86821]: WARNING cinder.db.api [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-649802435']
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['4fcdb2e7-64c7-45fb-9bd9-690a87a9e59a', 'b38d0a62-bdc1-416b-93ea-f02ec5b1e345', '89e32461-268f-4f78-9364-9c66f339bcf0', '3a9b67cb-2056-4a25-a09e-03a7e34f9062'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:26 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.422s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:16:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Deleted volume successfully.
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9abb93b9-05cf-42d5-8d93-774b59aa6595 tempest-DeleteServersTestJSON-988911967 None] Lock "cinder-fda4dfa0-d14f-4a1d-a04c-dc218bab4654-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:26 devstack sudo[89031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:16:26 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:27 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.381s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:27 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:16:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2c379851-169a-47f7-90f4-f8173da5aa47 tempest-GroupSnapshotsTest-402769389 None] Delete group completed successfully.
Sep 29 18:16:28 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e24108d1-108e-4fa2-b1d4-2f410d2a8b1e tempest-GroupSnapshotsTest-402769389 None] Group tempest-GroupSnapshotsTest-Group-1528406630: creating
Sep 29 18:16:28 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e24108d1-108e-4fa2-b1d4-2f410d2a8b1e tempest-GroupSnapshotsTest-402769389 None] Group tempest-GroupSnapshotsTest-Group-1528406630: created successfully
Sep 29 18:16:28 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e24108d1-108e-4fa2-b1d4-2f410d2a8b1e tempest-GroupSnapshotsTest-402769389 None] Create group completed successfully.
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Flow 'volume_create_manager' (4d3ff497-9879-4427-b366-e963f030f5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ae216c-7bd7-4ff2-b4bb-586d17059661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ae216c-7bd7-4ff2-b4bb-586d17059661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1089231633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c781160-4971-4c3f-afde-bd2727cd7ae8,host='devstack@QuobyteHD#QuobyteHD',id=4693e64e-a4b1-4117-8eb8-1b36e73fb25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee26bd6875db44e1b2f8b0f7651364fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:16:30Z,use_quota=True,user_id='9d85d117c8de4a249101317c90baf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cdff565-44b4-4e30-af8f-60a9eb80e4cc),volume_type_id=7cdff565-44b4-4e30-af8f-60a9eb80e4cc)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafdb7ef-4ec5-47d6-8870-552462069f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafdb7ef-4ec5-47d6-8870-552462069f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec53c12-864a-44c9-b09c-bbe0f550b7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec53c12-864a-44c9-b09c-bbe0f550b7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4693e64e-a4b1-4117-8eb8-1b36e73fb25d', 'volume_name': 'volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf34bfe-8507-4e51-86e8-a6a05d7710ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf34bfe-8507-4e51-86e8-a6a05d7710ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036fc379-4069-426a-8cef-8bcae7af0b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:30 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Volume 4693e64e-a4b1-4117-8eb8-1b36e73fb25d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d', 'volume_size': 1}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7c781160-4971-4c3f-afde-bd2727cd7ae8,created_at=2026-09-29T16:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1089231633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c781160-4971-4c3f-afde-bd2727cd7ae8,host='devstack@QuobyteHD#QuobyteHD',id=4693e64e-a4b1-4117-8eb8-1b36e73fb25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee26bd6875db44e1b2f8b0f7651364fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:16:30Z,use_quota=True,user_id='9d85d117c8de4a249101317c90baf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cdff565-44b4-4e30-af8f-60a9eb80e4cc),volume_type_id=7cdff565-44b4-4e30-af8f-60a9eb80e4cc)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Creating volume 4693e64e-a4b1-4117-8eb8-1b36e73fb25d {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:16:30 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:30 devstack sudo[89044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d 1073741824
Sep 29 18:16:30 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:30 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d 1073741824" returned: 0 in 0.553s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:30 devstack sudo[89049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d
Sep 29 18:16:30 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:31 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d" returned: 0 in 0.265s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:16:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036fc379-4069-426a-8cef-8bcae7af0b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb79a6a-97a3-4c84-803d-68fa85eef105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:31 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Volume volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d (4693e64e-a4b1-4117-8eb8-1b36e73fb25d): created successfully
Sep 29 18:16:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb79a6a-97a3-4c84-803d-68fa85eef105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Flow 'volume_create_manager' (4d3ff497-9879-4427-b366-e963f030f5a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:16:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f2cfdf41-ee73-4d6f-9a72-6886d3c37ca5 tempest-GroupSnapshotsTest-402769389 None] Created volume successfully.
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Flow 'volume_create_manager' (66e0df20-06de-4d96-b215-fcd14983cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a3c811-8584-4264-b088-1be20b0cd815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a3c811-8584-4264-b088-1be20b0cd815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-795779063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c781160-4971-4c3f-afde-bd2727cd7ae8,host='devstack@QuobyteHD#QuobyteHD',id=d9115f9c-4c28-455d-9d34-8f71a690f2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee26bd6875db44e1b2f8b0f7651364fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:16:32Z,use_quota=True,user_id='9d85d117c8de4a249101317c90baf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cdff565-44b4-4e30-af8f-60a9eb80e4cc),volume_type_id=7cdff565-44b4-4e30-af8f-60a9eb80e4cc)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6bf1b4-c262-4c81-aed3-ebd33c0f895a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6bf1b4-c262-4c81-aed3-ebd33c0f895a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff09318f-eefb-4ab3-888d-b73be85ebb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff09318f-eefb-4ab3-888d-b73be85ebb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9115f9c-4c28-455d-9d34-8f71a690f2dc', 'volume_name': 'volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d89c27d-8202-4063-8403-ee5bc1ef9da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d89c27d-8202-4063-8403-ee5bc1ef9da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f3817f-24e1-4540-9b72-1d923272c9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:32 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Volume d9115f9c-4c28-455d-9d34-8f71a690f2dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc', 'volume_size': 1}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7c781160-4971-4c3f-afde-bd2727cd7ae8,created_at=2026-09-29T16:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-795779063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c781160-4971-4c3f-afde-bd2727cd7ae8,host='devstack@QuobyteHD#QuobyteHD',id=d9115f9c-4c28-455d-9d34-8f71a690f2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee26bd6875db44e1b2f8b0f7651364fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:16:32Z,use_quota=True,user_id='9d85d117c8de4a249101317c90baf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cdff565-44b4-4e30-af8f-60a9eb80e4cc),volume_type_id=7cdff565-44b4-4e30-af8f-60a9eb80e4cc)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Creating volume d9115f9c-4c28-455d-9d34-8f71a690f2dc {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:16:32 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:32 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc 1073741824
Sep 29 18:16:32 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:32 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc 1073741824" returned: 0 in 0.699s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:32 devstack sudo[89060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc
Sep 29 18:16:32 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:33 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc" returned: 0 in 0.308s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:16:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f3817f-24e1-4540-9b72-1d923272c9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f0b2f-c8ab-4565-8ccb-3f502f322541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:33 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Volume volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc (d9115f9c-4c28-455d-9d34-8f71a690f2dc): created successfully
Sep 29 18:16:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f0b2f-c8ab-4565-8ccb-3f502f322541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Flow 'volume_create_manager' (66e0df20-06de-4d96-b215-fcd14983cacf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:16:33 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1759483a-dd4d-454f-9b3a-efa01dc2f2e2 tempest-GroupSnapshotsTest-402769389 None] Created volume successfully.
Sep 29 18:16:34 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-cf7fb4a7-1ffd-4006-b690-a4db7ba24d74 tempest-GroupSnapshotsTest-402769389 None] Update group completed successfully.
Sep 29 18:16:35 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5348b3cd-9bb8-42c6-95d7-6aab0077662b tempest-GroupSnapshotsTest-402769389 None] Update group completed successfully.
Sep 29 18:16:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8fd55046-7e2d-43de-aa30-eacab8a09c2d tempest-GroupSnapshotsTest-402769389 None] Update group completed successfully.
Sep 29 18:16:38 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6c552621-8656-49ba-9321-98d6b347e8b7 tempest-GroupSnapshotsTest-402769389 None] Update group completed successfully.
Sep 29 18:16:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] GroupSnapshot 57930be3-f2ff-4b08-aa7c-cc83e92bb119: creating.
Sep 29 18:16:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Group snapshot 57930be3-f2ff-4b08-aa7c-cc83e92bb119: creating. {{(pid=86821) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 18:16:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Creating offline snapshot 0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 of volume 4693e64e-a4b1-4117-8eb8-1b36e73fb25d {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:16:40 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e194ccf-b256-4d9f-a17e-38f1b1af7e00]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:40 devstack sudo[89108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d
Sep 29 18:16:40 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Acquiring lock "cinder-4c89110e-ee62-41ee-934b-3b6395539a45-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Lock "cinder-4c89110e-ee62-41ee-934b-3b6395539a45-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:41 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Acquiring lock "cinder-quobyte-4c89110e-ee62-41ee-934b-3b6395539a45" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d" returned: 0 in 0.636s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Lock "cinder-quobyte-4c89110e-ee62-41ee-934b-3b6395539a45" acquired by "delete_volume" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:41 devstack sudo[89128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 1G
Sep 29 18:16:41 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aca7991-e4c6-4dfd-a1e4-19f63beab27a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:41 devstack sudo[89130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45
Sep 29 18:16:41 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:41 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 1G" returned: 0 in 0.518s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:41 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45" returned: 0 in 0.455s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:41 devstack sudo[89143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866
Sep 29 18:16:41 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:41 devstack sudo[89144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45
Sep 29 18:16:41 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:41 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4c89110e-ee62-41ee-934b-3b6395539a45" returned: 0 in 0.254s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Lock "cinder-quobyte-4c89110e-ee62-41ee-934b-3b6395539a45" released by "delete_volume" :: held 0.780s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:41 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866" returned: 0 in 0.302s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:41 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:41 devstack sudo[89153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866
Sep 29 18:16:41 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:41 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Created reservations ['1e660678-69e1-4e63-afe1-1de8ffc05b59', '71aaa966-4040-4acf-9465-a075af970890', '66d2c1ec-0886-4ef2-a883-6ef1c7ce3af7', '390b4670-2287-41ce-884d-2941ecb8d42c'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:42 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:16:42 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:42 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866" returned: 0 in 0.311s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:42 devstack sudo[89158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.info
Sep 29 18:16:42 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:42 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.316s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:16:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Deleted volume successfully.
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5a759938-9113-422a-9b8f-c5c9ea1c199a tempest-TaggedAttachmentsTest-871449363 None] Lock "cinder-4c89110e-ee62-41ee-934b-3b6395539a45-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:42 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.info" returned: 0 in 0.336s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:42 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:42 devstack sudo[89162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.info
Sep 29 18:16:42 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:42 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.info" returned: 0 in 0.235s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Creating offline snapshot 2d22b095-87e5-4fa9-8675-8a78e7af917c of volume d9115f9c-4c28-455d-9d34-8f71a690f2dc {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d27ddb6-84c6-4471-9aa6-173c2ed3ddd5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:42 devstack sudo[89165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc
Sep 29 18:16:43 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:43 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc" returned: 0 in 0.434s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:43 devstack sudo[89170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c 1G
Sep 29 18:16:43 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:43 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c 1G" returned: 0 in 0.556s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:43 devstack sudo[89176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c
Sep 29 18:16:43 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:44 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c" returned: 0 in 0.363s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:44 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:16:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:44 devstack sudo[89181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c
Sep 29 18:16:44 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:44 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c" returned: 0 in 0.330s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:44 devstack sudo[89185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.info
Sep 29 18:16:44 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:44 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.info" returned: 0 in 0.284s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:44 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:16:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:44 devstack sudo[89188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.info
Sep 29 18:16:44 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:45 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.info" returned: 0 in 0.283s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-dc393a2e-f828-4f49-97e5-a3318a8c9ad9 tempest-GroupSnapshotsTest-402769389 None] group_snapshot 57930be3-f2ff-4b08-aa7c-cc83e92bb119: created successfully
Sep 29 18:16:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] group_snapshot 57930be3-f2ff-4b08-aa7c-cc83e92bb119: deleting
Sep 29 18:16:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] group_snapshot 57930be3-f2ff-4b08-aa7c-cc83e92bb119: deleting {{(pid=86821) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 18:16:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-4693e64e-a4b1-4117-8eb8-1b36e73fb25d" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-4693e64e-a4b1-4117-8eb8-1b36e73fb25d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-0b466b9b-ccb3-4241-8d6f-18b9a2ff1866" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-0b466b9b-ccb3-4241-8d6f-18b9a2ff1866" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Deleting offline snapshot 0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 of volume 4693e64e-a4b1-4117-8eb8-1b36e73fb25d {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:16:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] snapshot_file for this snap is: volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:16:46 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3be63fd-6286-4b0d-aa1a-fe15f36dd933]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:46 devstack sudo[89191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866
Sep 29 18:16:46 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:46 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866" returned: 0 in 0.478s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:16:46 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f014772-1f75-4895-a2d1-6b4d63c2efcd]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:46 devstack sudo[89199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d
Sep 29 18:16:46 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:46 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d" returned: 0 in 0.406s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:47 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866
Sep 29 18:16:47 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:47 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866" returned: 0 in 0.427s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:47 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866
Sep 29 18:16:47 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:47 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d.0b466b9b-ccb3-4241-8d6f-18b9a2ff1866" returned: 0 in 0.312s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-0b466b9b-ccb3-4241-8d6f-18b9a2ff1866" released by "_delete_snapshot" :: held 1.775s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-4693e64e-a4b1-4117-8eb8-1b36e73fb25d" released by "delete_snapshot" :: held 1.808s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-d9115f9c-4c28-455d-9d34-8f71a690f2dc" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-d9115f9c-4c28-455d-9d34-8f71a690f2dc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-2d22b095-87e5-4fa9-8675-8a78e7af917c" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-2d22b095-87e5-4fa9-8675-8a78e7af917c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Deleting offline snapshot 2d22b095-87e5-4fa9-8675-8a78e7af917c of volume d9115f9c-4c28-455d-9d34-8f71a690f2dc {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] snapshot_file for this snap is: volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[91913eda-4cb9-43c1-9302-9eba1dac981f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:47 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c
Sep 29 18:16:47 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:48 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c" returned: 0 in 0.409s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:16:48 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[41459ee7-b9e1-4dfe-b944-767c14d1ed8f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:48 devstack sudo[89218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc
Sep 29 18:16:48 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:48 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc" returned: 0 in 0.433s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:48 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c
Sep 29 18:16:48 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:49 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c" returned: 0 in 0.461s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:49 devstack sudo[89230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c
Sep 29 18:16:49 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:49 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc.2d22b095-87e5-4fa9-8675-8a78e7af917c" returned: 0 in 0.358s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-2d22b095-87e5-4fa9-8675-8a78e7af917c" released by "_delete_snapshot" :: held 1.803s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-d9115f9c-4c28-455d-9d34-8f71a690f2dc" released by "delete_snapshot" :: held 1.835s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:49 devstack cinder-volume[86821]: WARNING cinder.quota [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-333621665 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-333621665, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:16:49 devstack cinder-volume[86821]: WARNING cinder.quota [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-333621665 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-333621665, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:16:49 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['1976630a-c63a-43a9-a9dd-2b990120b184', '0db3a148-2b9c-4a81-b321-0aee9b10706c', '37d9cd38-6e08-4dd0-b59e-ab7d26288313', 'fd7b4917-ef43-4581-b88d-57cf09459b93'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:49 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['ac247859-64cc-43e9-aad1-8bc763256429', 'b690339a-92bc-4a04-af0e-2e920b8a1971', 'd14e75bf-2ffc-4386-9003-cef3575968cf', '44dc2366-91e1-4370-b854-5d5d04c5be29'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:50 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3d1059bc-a4d0-4258-9856-e79cb6de1255 tempest-GroupSnapshotsTest-402769389 None] group_snapshot 57930be3-f2ff-4b08-aa7c-cc83e92bb119: deleted successfully
Sep 29 18:16:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-4693e64e-a4b1-4117-8eb8-1b36e73fb25d" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-4693e64e-a4b1-4117-8eb8-1b36e73fb25d" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:51 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[007d3026-9ae7-48d3-baa1-62a9a92aa09a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:51 devstack sudo[89235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d
Sep 29 18:16:51 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:51 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d" returned: 0 in 0.437s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:51 devstack sudo[89241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d
Sep 29 18:16:51 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:51 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4693e64e-a4b1-4117-8eb8-1b36e73fb25d" returned: 0 in 0.283s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-4693e64e-a4b1-4117-8eb8-1b36e73fb25d" released by "delete_volume" :: held 0.821s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-d9115f9c-4c28-455d-9d34-8f71a690f2dc" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:16:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-d9115f9c-4c28-455d-9d34-8f71a690f2dc" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:16:52 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df996c30-d0f5-4967-bf58-23564797917c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:16:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:52 devstack sudo[89245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc
Sep 29 18:16:52 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:52 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc" returned: 0 in 0.512s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:52 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc
Sep 29 18:16:52 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:52 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d9115f9c-4c28-455d-9d34-8f71a690f2dc" returned: 0 in 0.391s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-d9115f9c-4c28-455d-9d34-8f71a690f2dc" released by "delete_volume" :: held 1.092s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:16:53 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['5a184266-a65d-4e9f-9fbd-390f90869f02'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:53 devstack cinder-volume[86821]: WARNING cinder.quota [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-333621665 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-333621665, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:16:53 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['e60d0ce3-b797-4d06-8ca3-5bd3ab1e1988', 'c6b3bd2b-8a79-4063-a4b7-a2f44630f7b4', 'fac4d09d-943f-440c-b55d-a3cb9887ecc0', 'a0149d48-1276-430e-8616-c129d6bced96'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:53 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=104,cinder:UPDATE=91,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:16:53 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['858f2391-25c8-4d9a-86db-1db84cf9afb5', 'ab9fa56b-7286-4322-9bc7-571d90c7f4b8', '7aa5d69c-3a3b-4435-9060-0d139a8269c2', '8779bc50-d44b-4362-a991-b2cf11a38e64'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:16:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:53 devstack sudo[89302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:16:53 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:54 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.371s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:16:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-402dc3d9-ae2b-405e-b758-f7a923209378 tempest-GroupSnapshotsTest-402769389 None] Delete group completed successfully.
Sep 29 18:16:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:16:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:54 devstack sudo[89328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:16:54 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:54 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.378s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:16:55 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-dc5a59a8-37da-4d72-92d0-eba2eeaf7e5f tempest-GroupSnapshotsTest-402769389 None] Group tempest-GroupSnapshotsTest-Group-1295911264: creating
Sep 29 18:16:55 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=119,cinder:UPDATE=111,cinder:INSERT=25,cinder:DELETE=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:16:55 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-dc5a59a8-37da-4d72-92d0-eba2eeaf7e5f tempest-GroupSnapshotsTest-402769389 None] Group tempest-GroupSnapshotsTest-Group-1295911264: created successfully
Sep 29 18:16:55 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-dc5a59a8-37da-4d72-92d0-eba2eeaf7e5f tempest-GroupSnapshotsTest-402769389 None] Create group completed successfully.
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Flow 'volume_create_manager' (ff1f3721-7ed4-47fb-be68-ec5e107b4fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d26186-f562-4978-9544-721a2e2f6cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d26186-f562-4978-9544-721a2e2f6cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1998290578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1f7b4141-fd4d-4220-9745-3dcdb4948b75,host='devstack@QuobyteHD#QuobyteHD',id=51c82eda-7573-4c38-9853-38d4e1b260d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee26bd6875db44e1b2f8b0f7651364fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:16:58Z,use_quota=True,user_id='9d85d117c8de4a249101317c90baf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fb7bbbb-8988-41ee-9fa1-f0679bd149b5),volume_type_id=7fb7bbbb-8988-41ee-9fa1-f0679bd149b5)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40aa7592-28c9-4f71-82a7-ff60ec6d7fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40aa7592-28c9-4f71-82a7-ff60ec6d7fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c2f533-65c1-414f-861e-756057a51b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c2f533-65c1-414f-861e-756057a51b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51c82eda-7573-4c38-9853-38d4e1b260d8', 'volume_name': 'volume-51c82eda-7573-4c38-9853-38d4e1b260d8', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3755d4ff-5854-4537-b8ba-3d6c88f776ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3755d4ff-5854-4537-b8ba-3d6c88f776ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d1fe06-b42e-446e-9bb9-61471d5d4530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:57 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Volume 51c82eda-7573-4c38-9853-38d4e1b260d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51c82eda-7573-4c38-9853-38d4e1b260d8', 'volume_size': 1}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1f7b4141-fd4d-4220-9745-3dcdb4948b75,created_at=2026-09-29T16:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1998290578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1f7b4141-fd4d-4220-9745-3dcdb4948b75,host='devstack@QuobyteHD#QuobyteHD',id=51c82eda-7573-4c38-9853-38d4e1b260d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee26bd6875db44e1b2f8b0f7651364fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:16:58Z,use_quota=True,user_id='9d85d117c8de4a249101317c90baf0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fb7bbbb-8988-41ee-9fa1-f0679bd149b5),volume_type_id=7fb7bbbb-8988-41ee-9fa1-f0679bd149b5)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Creating volume 51c82eda-7573-4c38-9853-38d4e1b260d8 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:16:57 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:16:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:57 devstack sudo[89346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8 1073741824
Sep 29 18:16:57 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:58 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8 1073741824" returned: 0 in 0.705s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:16:58 devstack sudo[89356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8
Sep 29 18:16:58 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:16:59 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root
Sep 29 18:16:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8" returned: 0 in 0.463s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:16:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:16:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:16:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d1fe06-b42e-446e-9bb9-61471d5d4530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c82eda-7573-4c38-9853-38d4e1b260d8', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d536b5-4cb7-4bbf-abdf-e63c5d6c05c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:16:59 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Volume volume-51c82eda-7573-4c38-9853-38d4e1b260d8 (51c82eda-7573-4c38-9853-38d4e1b260d8): created successfully
Sep 29 18:16:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d536b5-4cb7-4bbf-abdf-e63c5d6c05c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:16:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Flow 'volume_create_manager' (ff1f3721-7ed4-47fb-be68-ec5e107b4fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:16:59 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-80b29d0d-63a9-40ea-b137-2ab55a6cea5b tempest-GroupSnapshotsTest-402769389 None] Created volume successfully.
Sep 29 18:17:01 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] GroupSnapshot 95674fa8-05f5-42e1-a770-1c666539d348: creating.
Sep 29 18:17:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] Group snapshot 95674fa8-05f5-42e1-a770-1c666539d348: creating. {{(pid=86821) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 18:17:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] Creating offline snapshot 6671d46c-0653-49f0-9ce1-60b60e03b9f1 of volume 51c82eda-7573-4c38-9853-38d4e1b260d8 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:17:01 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b01b9c1-29b0-450a-8772-7511afbb4996]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:17:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:01 devstack sudo[89376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8
Sep 29 18:17:01 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:01 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8" returned: 0 in 0.575s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:01 devstack sudo[89391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1 1G
Sep 29 18:17:01 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:02 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1 1G" returned: 0 in 0.585s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51c82eda-7573-4c38-9853-38d4e1b260d8 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:02 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51c82eda-7573-4c38-9853-38d4e1b260d8 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1
Sep 29 18:17:02 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:02 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51c82eda-7573-4c38-9853-38d4e1b260d8 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1" returned: 0 in 0.596s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:02 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:17:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:03 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1
Sep 29 18:17:03 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:03 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1" returned: 0 in 0.475s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:03 devstack sudo[89407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.info
Sep 29 18:17:03 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:03 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.info" returned: 0 in 0.422s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:03 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:17:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:03 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.info
Sep 29 18:17:03 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:04 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.info" returned: 0 in 0.413s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.251s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:04 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1de33e97-c87f-4a52-9fdc-843360195fde tempest-GroupSnapshotsTest-402769389 None] group_snapshot 95674fa8-05f5-42e1-a770-1c666539d348: created successfully
Sep 29 18:17:06 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] group_snapshot 95674fa8-05f5-42e1-a770-1c666539d348: deleting
Sep 29 18:17:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] group_snapshot 95674fa8-05f5-42e1-a770-1c666539d348: deleting {{(pid=86821) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 18:17:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-51c82eda-7573-4c38-9853-38d4e1b260d8" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:17:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-51c82eda-7573-4c38-9853-38d4e1b260d8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:17:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-6671d46c-0653-49f0-9ce1-60b60e03b9f1" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:17:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-6671d46c-0653-49f0-9ce1-60b60e03b9f1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:17:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Deleting offline snapshot 6671d46c-0653-49f0-9ce1-60b60e03b9f1 of volume 51c82eda-7573-4c38-9853-38d4e1b260d8 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:17:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] snapshot_file for this snap is: volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:17:06 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed1c6dd-aa64-4a0e-b8b1-1f73b31a7b03]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:17:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:06 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1
Sep 29 18:17:06 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:07 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1" returned: 0 in 0.956s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51c82eda-7573-4c38-9853-38d4e1b260d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:17:07 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9a91e9-e267-4d87-8329-9426031a1ea3]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:17:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:07 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8
Sep 29 18:17:07 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:08 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8" returned: 0 in 0.667s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:08 devstack sudo[89516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1
Sep 29 18:17:08 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:08 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1" returned: 0 in 0.736s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:08 devstack sudo[89565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1
Sep 29 18:17:08 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:09 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8.6671d46c-0653-49f0-9ce1-60b60e03b9f1" returned: 0 in 0.327s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-6671d46c-0653-49f0-9ce1-60b60e03b9f1" released by "_delete_snapshot" :: held 2.918s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:17:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-51c82eda-7573-4c38-9853-38d4e1b260d8" released by "delete_snapshot" :: held 2.970s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:17:09 devstack cinder-volume[86821]: WARNING cinder.quota [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1038552095 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1038552095, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:17:09 devstack cinder-volume[86821]: WARNING cinder.quota [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1038552095 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1038552095, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:17:09 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['fca0aea9-7186-4088-8316-d4692a96dda8', '1a52dac5-f40d-4ccb-aa98-7cb779437f92', '1ecda6cf-0621-4e53-bbb2-3e03c96fa44d', '5a32e8d1-70bf-4610-b701-1bde3ac1ff81'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:17:09 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6b6f331f-4532-4389-a292-437729f42377 tempest-GroupSnapshotsTest-402769389 None] group_snapshot 95674fa8-05f5-42e1-a770-1c666539d348: deleted successfully
Sep 29 18:17:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "cinder-quobyte-51c82eda-7573-4c38-9853-38d4e1b260d8" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:17:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-51c82eda-7573-4c38-9853-38d4e1b260d8" acquired by "delete_volume" :: waited 0.063s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:17:10 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b61e17-8b7a-4786-88cb-e55864015573]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:17:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:10 devstack sudo[89574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8
Sep 29 18:17:10 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:11 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8" returned: 0 in 0.507s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:11 devstack sudo[89580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8
Sep 29 18:17:11 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:11 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-51c82eda-7573-4c38-9853-38d4e1b260d8" returned: 0 in 0.387s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Lock "cinder-quobyte-51c82eda-7573-4c38-9853-38d4e1b260d8" released by "delete_volume" :: held 1.013s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:17:11 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['07521330-9238-4cd3-9b9b-689edcc96497'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:17:11 devstack cinder-volume[86821]: WARNING cinder.quota [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1038552095 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1038552095, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:17:11 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Created reservations ['e6cdaa9f-1950-47c2-9b87-7225f606a228', 'e787b64c-216f-4f98-8ff3-766c7ffd0efa', '9aee8873-f1d7-4bd2-9eac-5d84d59280bb', 'a62d6b54-862d-4615-95a5-4ce66ea1cc98'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:17:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:17:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:17:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:12 devstack sudo[89585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:17:12 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:12 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.391s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:12 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:17:12 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-38e9d4ac-1e19-4cf1-bfa3-22e1f04a1025 tempest-GroupSnapshotsTest-402769389 None] Delete group completed successfully.
Sep 29 18:17:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=29,cinder:SELECT=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:17:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=29,cinder:UPDATE=22,cinder:INSERT=7 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Flow 'volume_create_manager' (1d764c3b-76a9-4ee9-a722-1149053b4b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c76088-1012-4149-9974-bc4492593d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c76088-1012-4149-9974-bc4492593d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1098131545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64bf0f4-3820-4dcf-b4a8-38d81613dea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6464a8934948f19288eb1459c99a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:23Z,use_quota=True,user_id='6388bccc91c942f496f072bea2c08b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e3d97c-4919-4c66-a8d8-90e287d48740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e3d97c-4919-4c66-a8d8-90e287d48740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d393374-e3df-41b3-864e-8461d00cd77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d393374-e3df-41b3-864e-8461d00cd77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f64bf0f4-3820-4dcf-b4a8-38d81613dea6', 'volume_name': 'volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d427d5c1-4a5c-4e76-8e42-87a77a0e9abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d427d5c1-4a5c-4e76-8e42-87a77a0e9abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af06247d-da92-4b34-9717-f5f1e82306ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:22 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Volume f64bf0f4-3820-4dcf-b4a8-38d81613dea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6', 'volume_size': 1}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1098131545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f64bf0f4-3820-4dcf-b4a8-38d81613dea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6464a8934948f19288eb1459c99a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:23Z,use_quota=True,user_id='6388bccc91c942f496f072bea2c08b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Creating volume f64bf0f4-3820-4dcf-b4a8-38d81613dea6 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:17:22 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:17:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:22 devstack sudo[89667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6 1073741824
Sep 29 18:17:22 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:23 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6 1073741824" returned: 0 in 0.647s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:23 devstack sudo[89674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6
Sep 29 18:17:23 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:23 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6" returned: 0 in 0.294s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:17:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af06247d-da92-4b34-9717-f5f1e82306ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ec7d2f-9671-4776-aefc-78a94bc4f6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:23 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Volume volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6 (f64bf0f4-3820-4dcf-b4a8-38d81613dea6): created successfully
Sep 29 18:17:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ec7d2f-9671-4776-aefc-78a94bc4f6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Flow 'volume_create_manager' (1d764c3b-76a9-4ee9-a722-1149053b4b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:17:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6cdbe7f2-1e1a-411d-b0eb-194420305d68 tempest-ServerActionsTestOtherA-1570517160 None] Created volume successfully.
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Flow 'volume_create_manager' (fb4a6055-be50-4006-949b-612e07f9ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a790a4d7-1738-49c3-bf8c-1f99743fd3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a790a4d7-1738-49c3-bf8c-1f99743fd3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1250242803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a79d147-93d3-4b94-b4be-fbd7c2beda64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a25e2ada76a1481daf0e899bec18871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:31Z,use_quota=True,user_id='1d950470a79c41e0be1f40cb4a725037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a06c2c6-cef8-4c5a-9144-f7b940810086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a06c2c6-cef8-4c5a-9144-f7b940810086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c00116d-6594-4b58-990d-4183fe90ebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c00116d-6594-4b58-990d-4183fe90ebae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a79d147-93d3-4b94-b4be-fbd7c2beda64', 'volume_name': 'volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80dd4bf-5251-41c7-92fa-d43776319387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80dd4bf-5251-41c7-92fa-d43776319387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d37b8c-ef36-4cb0-9880-69000bcb32a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:30 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Volume 9a79d147-93d3-4b94-b4be-fbd7c2beda64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64', 'volume_size': 1}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1250242803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a79d147-93d3-4b94-b4be-fbd7c2beda64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a25e2ada76a1481daf0e899bec18871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:31Z,use_quota=True,user_id='1d950470a79c41e0be1f40cb4a725037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Creating volume 9a79d147-93d3-4b94-b4be-fbd7c2beda64 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:17:30 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:17:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:30 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64 1073741824
Sep 29 18:17:30 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:31 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64 1073741824" returned: 0 in 0.793s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:31 devstack sudo[89759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64
Sep 29 18:17:31 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:32 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64" returned: 0 in 0.422s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:17:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d37b8c-ef36-4cb0-9880-69000bcb32a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ca563f-541d-44b7-9f34-f8fac597e923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:32 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Volume volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64 (9a79d147-93d3-4b94-b4be-fbd7c2beda64): created successfully
Sep 29 18:17:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ca563f-541d-44b7-9f34-f8fac597e923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Flow 'volume_create_manager' (fb4a6055-be50-4006-949b-612e07f9ae99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:17:32 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-97c3fe47-aa8b-4365-8a2b-07588bb2995c tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Created volume successfully.
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Flow 'volume_create_manager' (93154da2-d40a-4f60-8475-1adb257ac4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafd6c34-d500-4b66-8f77-48a758abfeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafd6c34-d500-4b66-8f77-48a758abfeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1287718315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074505f3-dfd5-4eec-85dd-573710120379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec13a29c5ab74834ac335086fd8bca6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:33Z,use_quota=True,user_id='6bb0640981f44648be1b9bc7f75d6a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da09ecc8-e2e7-45f1-b1cd-132d3f28598e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da09ecc8-e2e7-45f1-b1cd-132d3f28598e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c237cd69-49c8-4186-8e17-38a9d9b5c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c237cd69-49c8-4186-8e17-38a9d9b5c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '074505f3-dfd5-4eec-85dd-573710120379', 'volume_name': 'volume-074505f3-dfd5-4eec-85dd-573710120379', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5308b744-acc3-4ab5-93b8-db1092b8c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5308b744-acc3-4ab5-93b8-db1092b8c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3fe41c-8efb-4a02-a7c0-6b43bc6bfd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:33 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Volume 074505f3-dfd5-4eec-85dd-573710120379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-074505f3-dfd5-4eec-85dd-573710120379', 'volume_size': 1}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1287718315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074505f3-dfd5-4eec-85dd-573710120379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec13a29c5ab74834ac335086fd8bca6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:33Z,use_quota=True,user_id='6bb0640981f44648be1b9bc7f75d6a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Creating volume 074505f3-dfd5-4eec-85dd-573710120379 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:17:33 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:17:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:33 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379 1073741824
Sep 29 18:17:33 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:34 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379 1073741824" returned: 0 in 1.134s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:34 devstack sudo[89851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379
Sep 29 18:17:34 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:34 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379" returned: 0 in 0.382s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:17:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3fe41c-8efb-4a02-a7c0-6b43bc6bfd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074505f3-dfd5-4eec-85dd-573710120379', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e650af17-94b6-413b-bfd7-cb63c3d4500e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:34 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Volume volume-074505f3-dfd5-4eec-85dd-573710120379 (074505f3-dfd5-4eec-85dd-573710120379): created successfully
Sep 29 18:17:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e650af17-94b6-413b-bfd7-cb63c3d4500e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Flow 'volume_create_manager' (93154da2-d40a-4f60-8475-1adb257ac4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:17:34 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5c0c29a2-84f5-4dca-b351-86bd9b4d03a6 tempest-AttachVolumeShelveTestJSON-398844391 None] Created volume successfully.
Sep 29 18:17:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Acquiring lock "cinder-9a79d147-93d3-4b94-b4be-fbd7c2beda64-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:17:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Lock "cinder-9a79d147-93d3-4b94-b4be-fbd7c2beda64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:17:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Acquiring lock "cinder-quobyte-9a79d147-93d3-4b94-b4be-fbd7c2beda64" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:17:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Lock "cinder-quobyte-9a79d147-93d3-4b94-b4be-fbd7c2beda64" acquired by "delete_volume" :: waited 0.030s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:17:35 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf75cf2-ea3d-46c9-a7e4-5f63555848fa]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:17:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:36 devstack sudo[89906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64
Sep 29 18:17:36 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:36 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64" returned: 0 in 0.633s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:36 devstack sudo[89932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64
Sep 29 18:17:36 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:37 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9a79d147-93d3-4b94-b4be-fbd7c2beda64" returned: 0 in 0.458s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Lock "cinder-quobyte-9a79d147-93d3-4b94-b4be-fbd7c2beda64" released by "delete_volume" :: held 1.171s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:17:37 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Created reservations ['46cd42e1-01ad-4aca-aee0-b47297ae7033', 'f8b632db-6241-4e99-8f1a-baa97d7f7af8', 'ba863cf0-23be-4d52-be3b-65c9988f4613', '19f20aa6-dacc-43e2-bf79-f02194412ed3'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:17:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:17:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:17:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:37 devstack sudo[89950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:17:37 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:38 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.707s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:38 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:17:38 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Deleted volume successfully.
Sep 29 18:17:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112edb27-25de-4ca2-9105-94f8af014f68 tempest-VolumeQuotasNegativeTestJSON-1096733816 None] Lock "cinder-9a79d147-93d3-4b94-b4be-fbd7c2beda64-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:17:47 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=23,cinder:SELECT=9,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:17:48 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:17:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:17:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:17:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:17:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:54 devstack sudo[90090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:17:54 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:55 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.745s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:55 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:17:55 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:17:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 8 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:17:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:17:55 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:17:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Flow 'volume_create_manager' (3a7922bc-4178-4466-be20-bc4ab9186475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:17:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae14b85-8f08-47b2-971c-9e938a3bd19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae14b85-8f08-47b2-971c-9e938a3bd19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-523545536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d650e7a5-0cd5-414e-9fd3-1a8605b20aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5c8f744f0b4774b4e38652ed214473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:56Z,use_quota=True,user_id='d9ccd1a7154e4e78a50b4d42f6195e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88349b26-1349-43d2-903c-a35f4bf83355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88349b26-1349-43d2-903c-a35f4bf83355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82acfdb3-44c1-4d37-be32-c7d147a1a09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82acfdb3-44c1-4d37-be32-c7d147a1a09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd650e7a5-0cd5-414e-9fd3-1a8605b20aa3', 'volume_name': 'volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2ca5d3-f2dd-41f3-8c0b-4f13a48f4c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2ca5d3-f2dd-41f3-8c0b-4f13a48f4c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a9f6b8-f463-407d-ae39-41db0be1159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:56 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Volume d650e7a5-0cd5-414e-9fd3-1a8605b20aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3', 'volume_size': 1}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-523545536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d650e7a5-0cd5-414e-9fd3-1a8605b20aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5c8f744f0b4774b4e38652ed214473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:56Z,use_quota=True,user_id='d9ccd1a7154e4e78a50b4d42f6195e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Creating volume d650e7a5-0cd5-414e-9fd3-1a8605b20aa3 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:17:56 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:56 devstack sudo[90093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3 1073741824
Sep 29 18:17:56 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Flow 'volume_create_manager' (33ffca67-ffbb-425c-ae88-5d632d16f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe5cd3c-cd96-4e99-a004-a390c7ec84a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe5cd3c-cd96-4e99-a004-a390c7ec84a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1634992332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d025537-7d48-484b-be21-03e76fa3b092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c215c27847c246efb412e030448e7e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:57Z,use_quota=True,user_id='80500ec7c8c94d40a84a17c57ded3c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c49880-e47f-4e05-bbc4-53bfd2660313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c49880-e47f-4e05-bbc4-53bfd2660313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7086c1-2f01-4930-b428-a92191efb06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7086c1-2f01-4930-b428-a92191efb06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d025537-7d48-484b-be21-03e76fa3b092', 'volume_name': 'volume-5d025537-7d48-484b-be21-03e76fa3b092', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d688a8-0c8b-4fbf-ae16-77f35abc4864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d688a8-0c8b-4fbf-ae16-77f35abc4864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2687c1e9-4e68-4708-b33a-0397f8aa31cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:56 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Volume 5d025537-7d48-484b-be21-03e76fa3b092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d025537-7d48-484b-be21-03e76fa3b092', 'volume_size': 1}
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:56 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3 1073741824" returned: 0 in 0.924s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:57 devstack sudo[90098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3
Sep 29 18:17:57 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-da431761-3709-4b73-b493-79b25361cb84 req-51ba51ba-c4eb-4562-bb78-8d30fb39a6f8 tempest-AttachVolumeShelveTestJSON-398844391 None] No connector for attachment c3d14d70-6c9f-4fb7-8f97-4aca400bbcdf; skipping storage backend terminate_connection call. {{(pid=86821) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-da431761-3709-4b73-b493-79b25361cb84 req-51ba51ba-c4eb-4562-bb78-8d30fb39a6f8 tempest-AttachVolumeShelveTestJSON-398844391 None] Deleting attachment c3d14d70-6c9f-4fb7-8f97-4aca400bbcdf. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:17:57 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3" returned: 0 in 0.347s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1634992332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d025537-7d48-484b-be21-03e76fa3b092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c215c27847c246efb412e030448e7e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:57Z,use_quota=True,user_id='80500ec7c8c94d40a84a17c57ded3c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Creating volume 5d025537-7d48-484b-be21-03e76fa3b092 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:17:57 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:57 devstack sudo[90102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092 1073741824
Sep 29 18:17:57 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a9f6b8-f463-407d-ae39-41db0be1159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00640317-b16b-4268-af19-ba1916f827d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:57 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Volume volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3 (d650e7a5-0cd5-414e-9fd3-1a8605b20aa3): created successfully
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00640317-b16b-4268-af19-ba1916f827d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Flow 'volume_create_manager' (3a7922bc-4178-4466-be20-bc4ab9186475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:17:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1dcfcee9-a4e3-400e-be2f-08b5c912826a tempest-ServerRescueNegativeTestJSON-306600145 None] Created volume successfully.
Sep 29 18:17:58 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092 1073741824" returned: 0 in 1.053s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:17:58 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092
Sep 29 18:17:58 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:17:59 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Sep 29 18:17:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092" returned: 0 in 0.503s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:17:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:17:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:17:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2687c1e9-4e68-4708-b33a-0397f8aa31cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d025537-7d48-484b-be21-03e76fa3b092', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f674fc92-6655-436a-96d7-86263c2aec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:17:59 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Volume volume-5d025537-7d48-484b-be21-03e76fa3b092 (5d025537-7d48-484b-be21-03e76fa3b092): created successfully
Sep 29 18:17:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f674fc92-6655-436a-96d7-86263c2aec68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:17:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Flow 'volume_create_manager' (33ffca67-ffbb-425c-ae88-5d632d16f47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:17:59 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a3b931f6-a4a2-4f24-82ef-953a2b04bd8f tempest-VolumesServicesTestJSON-845148315 None] Created volume successfully.
Sep 29 18:18:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Acquiring lock "cinder-5d025537-7d48-484b-be21-03e76fa3b092-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:18:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Lock "cinder-5d025537-7d48-484b-be21-03e76fa3b092-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:18:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Acquiring lock "cinder-quobyte-5d025537-7d48-484b-be21-03e76fa3b092" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:18:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Lock "cinder-quobyte-5d025537-7d48-484b-be21-03e76fa3b092" acquired by "delete_volume" :: waited 0.030s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:18:00 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e009d1d5-981e-45e8-8e4e-1770ac7a426e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:18:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:18:00 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092
Sep 29 18:18:00 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:18:00 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Sep 29 18:18:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092" returned: 0 in 0.545s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:18:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:18:00 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092
Sep 29 18:18:00 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:18:01 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d025537-7d48-484b-be21-03e76fa3b092" returned: 0 in 0.403s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Lock "cinder-quobyte-5d025537-7d48-484b-be21-03e76fa3b092" released by "delete_volume" :: held 1.045s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Created reservations ['a8bf7712-200a-46a4-953b-52d8e50d9608', 'fcbdec81-963b-40f2-99f3-5a5a007b21c9', '179012a8-7d5d-4a9e-be30-b92ce3a8d8e0', '4cfc9b81-91f0-457e-a6a2-8a0d82601920'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:18:01 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:18:01 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:18:01 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.330s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:18:01 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Deleted volume successfully.
Sep 29 18:18:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-781ae5ad-617b-4c2d-9930-f85df5d89664 tempest-VolumesServicesTestJSON-845148315 None] Lock "cinder-5d025537-7d48-484b-be21-03e76fa3b092-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:18:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Acquiring lock "cinder-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:18:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Lock "cinder-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:18:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Acquiring lock "cinder-quobyte-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:18:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Lock "cinder-quobyte-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3" acquired by "delete_volume" :: waited 0.036s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:18:13 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdb29d1-82bd-4a77-b7af-89a3c821e312]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:18:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:18:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-85b926d3-ed82-493c-ba04-024412cc6876 req-2a5027f5-0dbb-47e1-b99d-787bb60802b0 tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:18:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-85b926d3-ed82-493c-ba04-024412cc6876 req-2a5027f5-0dbb-47e1-b99d-787bb60802b0 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:18:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-85b926d3-ed82-493c-ba04-024412cc6876 req-2a5027f5-0dbb-47e1-b99d-787bb60802b0 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:18:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-85b926d3-ed82-493c-ba04-024412cc6876 req-2a5027f5-0dbb-47e1-b99d-787bb60802b0 tempest-ServerActionsTestOtherA-1570517160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf8f0ff2-43a8-496b-a0bc-4738ff0e9f68', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:18:13 devstack sudo[90435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3
Sep 29 18:18:13 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:18:13 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-85b926d3-ed82-493c-ba04-024412cc6876 req-2a5027f5-0dbb-47e1-b99d-787bb60802b0 tempest-ServerActionsTestOtherA-1570517160 None] attachment_update completed successfully.
Sep 29 18:18:14 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root
Sep 29 18:18:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3" returned: 0 in 1.274s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:18:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:18:14 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3
Sep 29 18:18:14 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:18:15 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Sep 29 18:18:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3" returned: 0 in 0.782s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:18:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Lock "cinder-quobyte-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3" released by "delete_volume" :: held 2.167s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:18:15 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Created reservations ['9aae8ad6-ab15-46b6-b76c-afc7d180d07f', '34fd852c-e023-4aaa-9f18-68c4a721abf7', '922e9b9f-7ef1-47b4-841c-9f0f3ccc0069', '5199d973-f417-446b-8560-47fee24825e8'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:18:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:18:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:18:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:18:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:18:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:18:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:18:15 devstack sudo[90952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:18:15 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:18:16 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root
Sep 29 18:18:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.583s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:18:16 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:18:16 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Deleted volume successfully.
Sep 29 18:18:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5680de9a-389f-4f70-87b3-aee4d23a1fbd tempest-ServerRescueNegativeTestJSON-306600145 None] Lock "cinder-d650e7a5-0cd5-414e-9fd3-1a8605b20aa3-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:18:23 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-66954d57-0294-4dab-a29f-8ffe01708322 req-490d4446-62e3-4d99-8699-03a6c1b3b15b tempest-ServerActionsTestOtherA-1570517160 None] Terminate volume connection completed successfully.
Sep 29 18:18:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-66954d57-0294-4dab-a29f-8ffe01708322 req-490d4446-62e3-4d99-8699-03a6c1b3b15b tempest-ServerActionsTestOtherA-1570517160 None] Deleting attachment bf8f0ff2-43a8-496b-a0bc-4738ff0e9f68. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:18:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-66954d57-0294-4dab-a29f-8ffe01708322 req-64cc5215-b323-4ac2-aa20-aeefea66cbcf tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:18:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-66954d57-0294-4dab-a29f-8ffe01708322 req-64cc5215-b323-4ac2-aa20-aeefea66cbcf tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:18:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-66954d57-0294-4dab-a29f-8ffe01708322 req-64cc5215-b323-4ac2-aa20-aeefea66cbcf tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:18:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-66954d57-0294-4dab-a29f-8ffe01708322 req-64cc5215-b323-4ac2-aa20-aeefea66cbcf tempest-ServerActionsTestOtherA-1570517160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ebbd851-c230-4e70-ba43-7e132e02e614', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:18:25 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-66954d57-0294-4dab-a29f-8ffe01708322 req-64cc5215-b323-4ac2-aa20-aeefea66cbcf tempest-ServerActionsTestOtherA-1570517160 None] attachment_update completed successfully.
Sep 29 18:18:35 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=21,cinder:SELECT=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:18:35 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=33,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:18:54 devstack sudo[91698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:18:54 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:18:54 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.425s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 8 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:18:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:18:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Acquiring lock "cinder-074505f3-dfd5-4eec-85dd-573710120379-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:18:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Lock "cinder-074505f3-dfd5-4eec-85dd-573710120379-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:18:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Acquiring lock "cinder-quobyte-074505f3-dfd5-4eec-85dd-573710120379" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:18:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Lock "cinder-quobyte-074505f3-dfd5-4eec-85dd-573710120379" acquired by "delete_volume" :: waited 0.030s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:18:57 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afe4407-00ee-4e8f-a3a6-345fcb31b068]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:18:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:18:57 devstack sudo[91721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379
Sep 29 18:18:57 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:18:57 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root
Sep 29 18:18:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379" returned: 0 in 0.603s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:18:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:18:57 devstack sudo[91731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379
Sep 29 18:18:57 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:18:58 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-81f01f87-8fe4-4e20-90c2-e932e3bdb37a req-c0858cef-eeb2-4885-b6e6-980907eb8137 tempest-ServerActionsTestOtherA-1570517160 None] Terminate volume connection completed successfully.
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-81f01f87-8fe4-4e20-90c2-e932e3bdb37a req-c0858cef-eeb2-4885-b6e6-980907eb8137 tempest-ServerActionsTestOtherA-1570517160 None] Deleting attachment 3ebbd851-c230-4e70-ba43-7e132e02e614. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:18:58 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-074505f3-dfd5-4eec-85dd-573710120379" returned: 0 in 0.347s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Lock "cinder-quobyte-074505f3-dfd5-4eec-85dd-573710120379" released by "delete_volume" :: held 1.036s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Created reservations ['8b4d86c4-4dc0-4b01-9114-c6ad1b99df6a', '17f71d29-fbca-4b53-ba38-41ae7eb09988', '0e692d15-8747-43c4-b980-c373377fce70', '41e1f861-5b7b-4887-b4ca-71acce7fb705'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:18:58 devstack sudo[91736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:18:58 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:18:58 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.379s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:18:58 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Deleted volume successfully.
Sep 29 18:18:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5cc75d94-7ca1-4ad8-b9ed-608a350beaf6 tempest-AttachVolumeShelveTestJSON-398844391 None] Lock "cinder-074505f3-dfd5-4eec-85dd-573710120379-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:08 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:19:08 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:19:10 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:19:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Flow 'volume_create_manager' (c42ef114-8ed3-4bbd-850b-9ff3c9d6aa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c58a2c-49e1-40b7-bb17-7256255bf8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c58a2c-49e1-40b7-bb17-7256255bf8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1457421832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9730cd46-d582-4588-a0b5-2db892452e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6464a8934948f19288eb1459c99a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:11Z,use_quota=True,user_id='6388bccc91c942f496f072bea2c08b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a258359a-4c23-4d31-bca1-e6ec29f521fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a258359a-4c23-4d31-bca1-e6ec29f521fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9049b4ae-acef-455a-8fb4-d6a47d351a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:10 devstack cinder-volume[86821]: DEBUG cinder.image.glance [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Creating Keystone auth plugin from conf {{(pid=86821) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 18:19:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9049b4ae-acef-455a-8fb4-d6a47d351a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9730cd46-d582-4588-a0b5-2db892452e00', 'volume_name': 'volume-9730cd46-d582-4588-a0b5-2db892452e00', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b9692b290>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00499d8-b57e-4c37-b5c2-ecae6d347c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00499d8-b57e-4c37-b5c2-ecae6d347c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b1d020-b571-4a97-8396-755dd4b32e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:13 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Volume 9730cd46-d582-4588-a0b5-2db892452e00: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9730cd46-d582-4588-a0b5-2db892452e00', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b9692b290>}
Sep 29 18:19:13 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Trying to clone 9730cd46-d582-4588-a0b5-2db892452e00 from image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]). {{(pid=86821) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 18:19:14 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (c87119fa-0352-44c0-8897-ba4ee957787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a966943-5138-4986-a77d-1dc5c23f80bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a966943-5138-4986-a77d-1dc5c23f80bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-822612613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e10904-0d38-4a7a-9f01-0c04e5220874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:14Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d919d71f-6813-4fde-b027-7f18a62d43ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d919d71f-6813-4fde-b027-7f18a62d43ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ff97fe-681a-449e-b10e-35dda3ed3e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ff97fe-681a-449e-b10e-35dda3ed3e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e10904-0d38-4a7a-9f01-0c04e5220874', 'volume_name': 'volume-70e10904-0d38-4a7a-9f01-0c04e5220874', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf52e94d-b5be-4007-a5f7-c358a7e29a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf52e94d-b5be-4007-a5f7-c358a7e29a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5acbe0a5-7dee-4f9b-8f29-a53c85fda3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:14 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Volume 70e10904-0d38-4a7a-9f01-0c04e5220874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e10904-0d38-4a7a-9f01-0c04e5220874', 'volume_size': 1}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-822612613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e10904-0d38-4a7a-9f01-0c04e5220874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:14Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Creating volume 70e10904-0d38-4a7a-9f01-0c04e5220874 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:19:14 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:14 devstack sudo[92017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874 1073741824
Sep 29 18:19:14 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b019da-c6d1-4b5c-a0ec-16a2f4d00ffc]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:19:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:14 devstack sudo[92019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD
Sep 29 18:19:14 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:15 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874 1073741824" returned: 0 in 0.886s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:15 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD" returned: 0 in 0.933s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:15 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Temporary image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb is fetched for user 6388bccc91c942f496f072bea2c08b45. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 18:19:15 devstack sudo[92029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874
Sep 29 18:19:15 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:15 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[988713aa-1860-4061-8d21-1ff38b1f8a7a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:19:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:15 devstack sudo[92031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD
Sep 29 18:19:15 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:15 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874" returned: 0 in 0.758s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:19:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5acbe0a5-7dee-4f9b-8f29-a53c85fda3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e10904-0d38-4a7a-9f01-0c04e5220874', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e025fa-b864-4113-a2d6-19272a2cac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:16 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Volume volume-70e10904-0d38-4a7a-9f01-0c04e5220874 (70e10904-0d38-4a7a-9f01-0c04e5220874): created successfully
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e025fa-b864-4113-a2d6-19272a2cac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (c87119fa-0352-44c0-8897-ba4ee957787b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:16 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d8f7ab25-5fc9-4dd0-aeca-824dbcc057f0 tempest-VolumesActionsTest-1794902551 None] Created volume successfully.
Sep 29 18:19:16 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD" returned: 0 in 0.704s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1457421832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9730cd46-d582-4588-a0b5-2db892452e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6464a8934948f19288eb1459c99a0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:11Z,use_quota=True,user_id='6388bccc91c942f496f072bea2c08b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Creating volume 9730cd46-d582-4588-a0b5-2db892452e00 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:19:16 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:19:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:16 devstack sudo[92071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00 1073741824
Sep 29 18:19:16 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:17 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00 1073741824" returned: 0 in 1.282s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5c4ef8d8-c24e-4360-a996-162e9fce3ccf tempest-VolumesActionsTest-1794902551 None] Acquiring lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874" by "attach_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5c4ef8d8-c24e-4360-a996-162e9fce3ccf tempest-VolumesActionsTest-1794902551 None] Lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874" acquired by "attach_volume" :: waited 0.092s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:17 devstack sudo[92093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00
Sep 29 18:19:17 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:17 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5c4ef8d8-c24e-4360-a996-162e9fce3ccf tempest-VolumesActionsTest-1794902551 None] Attaching volume 70e10904-0d38-4a7a-9f01-0c04e5220874 to instance b88af57a-59aa-4bef-b926-cae195575979 at mountpoint /dev/vdb on host None.
Sep 29 18:19:17 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5c4ef8d8-c24e-4360-a996-162e9fce3ccf tempest-VolumesActionsTest-1794902551 None] Attach volume completed successfully.
Sep 29 18:19:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5c4ef8d8-c24e-4360-a996-162e9fce3ccf tempest-VolumesActionsTest-1794902551 None] Lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874" released by "attach_volume" :: held 0.228s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:18 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00" returned: 0 in 0.473s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:18 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:19:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:18 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Attempting download of d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb ((None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}])) to volume 9730cd46-d582-4588-a0b5-2db892452e00. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 18:19:18 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5870f7f4-afa9-4e64-b6cb-3a05a542e12b]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:19:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k793wulf {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:18 devstack sudo[92099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k793wulf
Sep 29 18:19:18 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:19 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k793wulf" returned: 0 in 0.665s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k793wulf {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:19 devstack sudo[92103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k793wulf
Sep 29 18:19:19 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:19 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d2ff2bfc-182d-421e-b18d-6c0be0551e36 tempest-VolumesActionsTest-314727789 None] Terminate volume connection completed successfully.
Sep 29 18:19:19 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d2ff2bfc-182d-421e-b18d-6c0be0551e36 tempest-VolumesActionsTest-314727789 None] Acquiring lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874-detach_volume" by "detach_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k793wulf" returned: 1 in 0.594s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k793wulf' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:19:19 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d0529f-3d47-44e1-84f3-fc1736e0f741]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:19:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d2ff2bfc-182d-421e-b18d-6c0be0551e36 tempest-VolumesActionsTest-314727789 None] Lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:19 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d2ff2bfc-182d-421e-b18d-6c0be0551e36 tempest-VolumesActionsTest-314727789 None] Detaching volume 70e10904-0d38-4a7a-9f01-0c04e5220874 from instance b88af57a-59aa-4bef-b926-cae195575979.
Sep 29 18:19:19 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d2ff2bfc-182d-421e-b18d-6c0be0551e36 tempest-VolumesActionsTest-314727789 None] Detach volume completed successfully.
Sep 29 18:19:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d2ff2bfc-182d-421e-b18d-6c0be0551e36 tempest-VolumesActionsTest-314727789 None] Lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874-detach_volume" released by "detach_volume" :: held 0.228s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:20 devstack sudo[92107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD
Sep 29 18:19:20 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-164b6323-3f63-4176-80b6-553366378682 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874-detach_volume" by "detach_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-164b6323-3f63-4176-80b6-553366378682 tempest-VolumesActionsTest-1794902551 None] Lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:20 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-164b6323-3f63-4176-80b6-553366378682 tempest-VolumesActionsTest-1794902551 None] Volume detach called, but volume not attached.
Sep 29 18:19:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-164b6323-3f63-4176-80b6-553366378682 tempest-VolumesActionsTest-1794902551 None] Lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874-detach_volume" released by "detach_volume" :: held 0.049s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:20 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD" returned: 0 in 0.917s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:20 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb was qcow2, converting to qcow2 {{(pid=86821) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 18:19:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:20 devstack sudo[92112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00
Sep 29 18:19:20 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Acquiring lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Acquiring lock "cinder-quobyte-70e10904-0d38-4a7a-9f01-0c04e5220874" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Lock "cinder-quobyte-70e10904-0d38-4a7a-9f01-0c04e5220874" acquired by "delete_volume" :: waited 0.038s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:21 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50213d3-dc5e-49b4-aa93-fa487a30e455]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:19:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:21 devstack sudo[92122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874
Sep 29 18:19:21 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:22 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874" returned: 0 in 0.849s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:22 devstack sudo[92130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874
Sep 29 18:19:22 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:23 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-70e10904-0d38-4a7a-9f01-0c04e5220874" returned: 0 in 0.648s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Lock "cinder-quobyte-70e10904-0d38-4a7a-9f01-0c04e5220874" released by "delete_volume" :: held 1.619s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:23 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Created reservations ['51cede7d-67e1-44a1-84eb-81eea496e0bb', 'cd86bbff-c965-493d-b3e5-810084283a24', '46e3bfa2-c6c7-421a-b519-69ff4fcbf97a', 'dc560eb9-66a9-43c3-b2bc-bcac437ebf08'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:19:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:23 devstack sudo[92134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:19:23 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:24 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.683s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:24 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:19:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Deleted volume successfully.
Sep 29 18:19:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3590f3cd-0d0a-4844-a7ec-1ee29801cadd tempest-VolumesActionsTest-1794902551 None] Lock "cinder-70e10904-0d38-4a7a-9f01-0c04e5220874-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:24 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00" returned: 0 in 4.376s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:24 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb__18ug48fdevstack@QuobyteHD, size 112.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00 {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:19:24 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Converted 112.00 MB image at 25.59 MB/s
Sep 29 18:19:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:25 devstack sudo[92192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00 1G
Sep 29 18:19:25 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:25 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00 1G" returned: 0 in 0.479s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:25 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Downloaded image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb ((None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}])) to volume 9730cd46-d582-4588-a0b5-2db892452e00 successfully. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 18:19:25 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Temporary image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb for user 6388bccc91c942f496f072bea2c08b45 is deleted. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 18:19:25 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Marking volume 9730cd46-d582-4588-a0b5-2db892452e00 as bootable. {{(pid=86821) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 18:19:25 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Copying metadata from image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb to 9730cd46-d582-4588-a0b5-2db892452e00. {{(pid=86821) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 18:19:25 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Creating volume glance metadata for volume 9730cd46-d582-4588-a0b5-2db892452e00 backed by image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86821) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 18:19:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b1d020-b571-4a97-8396-755dd4b32e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9730cd46-d582-4588-a0b5-2db892452e00', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b9692b290>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39521921-acf8-4ce8-ae21-786a65dab942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:25 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Volume volume-9730cd46-d582-4588-a0b5-2db892452e00 (9730cd46-d582-4588-a0b5-2db892452e00): created successfully
Sep 29 18:19:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39521921-acf8-4ce8-ae21-786a65dab942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Flow 'volume_create_manager' (c42ef114-8ed3-4bbd-850b-9ff3c9d6aa4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:25 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-542911ff-b3cb-46d8-a96a-19c7beee7c7c tempest-ServerActionsTestOtherA-1570517160 None] Created volume successfully.
Sep 29 18:19:30 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:19:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (70577e9e-987a-4c48-9f4c-6a4376286dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5a34f0-2ea1-4fbf-a83a-5cdfc793c86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5a34f0-2ea1-4fbf-a83a-5cdfc793c86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1541896710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd16a957-7306-46ec-84a1-b6a7cb05760c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:31Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d13d47b-7f94-4fdd-8437-4a9be12b8beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d13d47b-7f94-4fdd-8437-4a9be12b8beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0feef3c9-61bd-4ddb-b7bd-621363742b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0feef3c9-61bd-4ddb-b7bd-621363742b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd16a957-7306-46ec-84a1-b6a7cb05760c', 'volume_name': 'volume-fd16a957-7306-46ec-84a1-b6a7cb05760c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67d8423-be24-4dbd-9a7d-9a284ce406ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67d8423-be24-4dbd-9a7d-9a284ce406ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55203ce7-73ce-417a-be02-282cec0e9d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:31 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Volume fd16a957-7306-46ec-84a1-b6a7cb05760c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd16a957-7306-46ec-84a1-b6a7cb05760c', 'volume_size': 1}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1541896710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd16a957-7306-46ec-84a1-b6a7cb05760c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:31Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Creating volume fd16a957-7306-46ec-84a1-b6a7cb05760c {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:19:31 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:31 devstack sudo[92286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c 1073741824
Sep 29 18:19:31 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:31 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c 1073741824" returned: 0 in 0.851s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-3d0b6e1c-13b6-46f1-8c54-451cb05d8ced req-fca51237-662c-4354-9488-e20b9f1d01ee tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:32 devstack sudo[92309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c
Sep 29 18:19:32 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:32 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c" returned: 0 in 0.257s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-3d0b6e1c-13b6-46f1-8c54-451cb05d8ced req-fca51237-662c-4354-9488-e20b9f1d01ee tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.242s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55203ce7-73ce-417a-be02-282cec0e9d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd16a957-7306-46ec-84a1-b6a7cb05760c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b41f54c-fe29-4d9d-86f0-ca2e6fc33d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-3d0b6e1c-13b6-46f1-8c54-451cb05d8ced req-fca51237-662c-4354-9488-e20b9f1d01ee tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:32 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Volume volume-fd16a957-7306-46ec-84a1-b6a7cb05760c (fd16a957-7306-46ec-84a1-b6a7cb05760c): created successfully
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b41f54c-fe29-4d9d-86f0-ca2e6fc33d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (70577e9e-987a-4c48-9f4c-6a4376286dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:32 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c5e8a268-46eb-4dcd-a4eb-b7d7626f5c19 tempest-VolumesActionsTest-1794902551 None] Created volume successfully.
Sep 29 18:19:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-3d0b6e1c-13b6-46f1-8c54-451cb05d8ced req-fca51237-662c-4354-9488-e20b9f1d01ee tempest-ServerActionsTestOtherA-1570517160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-9730cd46-d582-4588-a0b5-2db892452e00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c2c01b4-3e73-4ea1-87ab-978d4e5c880a', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:19:32 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-3d0b6e1c-13b6-46f1-8c54-451cb05d8ced req-fca51237-662c-4354-9488-e20b9f1d01ee tempest-ServerActionsTestOtherA-1570517160 None] attachment_update completed successfully.
Sep 29 18:19:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Acquiring lock "cinder-fd16a957-7306-46ec-84a1-b6a7cb05760c-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Lock "cinder-fd16a957-7306-46ec-84a1-b6a7cb05760c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Acquiring lock "cinder-quobyte-fd16a957-7306-46ec-84a1-b6a7cb05760c" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Lock "cinder-quobyte-fd16a957-7306-46ec-84a1-b6a7cb05760c" acquired by "delete_volume" :: waited 0.041s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:33 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[525e6224-7773-4490-9cad-26fbdd11e9a0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:19:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:33 devstack sudo[92315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c
Sep 29 18:19:33 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:33 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c" returned: 0 in 0.687s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:34 devstack sudo[92320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c
Sep 29 18:19:34 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:34 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fd16a957-7306-46ec-84a1-b6a7cb05760c" returned: 0 in 0.370s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Lock "cinder-quobyte-fd16a957-7306-46ec-84a1-b6a7cb05760c" released by "delete_volume" :: held 1.165s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:34 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Created reservations ['fa764490-120a-4514-a4d7-855adcec2b6f', 'f3a06256-f916-4fb4-ab78-ab7684b37959', 'e2a9f1f3-a057-499e-a8dc-f376b10bdd2e', '9076fe41-bf3a-4878-a7e1-bd47e831112b'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:19:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:34 devstack sudo[92324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:19:34 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:35 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.409s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:35 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:19:35 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Deleted volume successfully.
Sep 29 18:19:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2d777a28-5466-4f5f-8988-829c4d1205b0 tempest-VolumesActionsTest-314727789 None] Lock "cinder-fd16a957-7306-46ec-84a1-b6a7cb05760c-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (69d1bd61-109b-4d4c-8a1e-55b5950ccf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eeefe88-1d5d-4f77-a3e8-a28fc9a15ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eeefe88-1d5d-4f77-a3e8-a28fc9a15ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-923162801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1d4121-368f-4257-8383-97b1ab197dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:36Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89035b42-d709-4eff-b93f-8cbcc65a9942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89035b42-d709-4eff-b93f-8cbcc65a9942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9902e19b-3a26-4e83-a1c6-9fa9695de658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9902e19b-3a26-4e83-a1c6-9fa9695de658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1d4121-368f-4257-8383-97b1ab197dea', 'volume_name': 'volume-1e1d4121-368f-4257-8383-97b1ab197dea', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6945ed-03b6-4311-b390-7567dce30584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6945ed-03b6-4311-b390-7567dce30584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96714304-138a-4d45-ae22-0aa80bffba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:36 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Volume 1e1d4121-368f-4257-8383-97b1ab197dea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1d4121-368f-4257-8383-97b1ab197dea', 'volume_size': 1}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-923162801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1d4121-368f-4257-8383-97b1ab197dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:36Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Creating volume 1e1d4121-368f-4257-8383-97b1ab197dea {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:19:36 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:36 devstack sudo[92327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea 1073741824
Sep 29 18:19:36 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:36 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea 1073741824" returned: 0 in 0.702s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:36 devstack sudo[92334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea
Sep 29 18:19:36 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:37 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea" returned: 0 in 0.335s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96714304-138a-4d45-ae22-0aa80bffba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1d4121-368f-4257-8383-97b1ab197dea', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07913c34-9d12-4888-9a5d-0187ae739c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:37 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Volume volume-1e1d4121-368f-4257-8383-97b1ab197dea (1e1d4121-368f-4257-8383-97b1ab197dea): created successfully
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07913c34-9d12-4888-9a5d-0187ae739c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (69d1bd61-109b-4d4c-8a1e-55b5950ccf12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-dff4b995-73fc-4581-94d6-3a5fa4a8db30 tempest-VolumesActionsTest-1794902551 None] Created volume successfully.
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Flow 'volume_create_manager' (48d38468-6b78-44e5-809d-b01a62cd7627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14aaee43-3fd9-4fcb-b5c3-93b8be673cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14aaee43-3fd9-4fcb-b5c3-93b8be673cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1212632459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57ab46f-f34c-412c-ac9e-9a1fe9976ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fbae69fae04307aa893d01bc14b514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:38Z,use_quota=True,user_id='c42217af044c444f92cc429d12ad323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc2a85c-4d7d-4bf2-bbc0-25fd8ccf2a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc2a85c-4d7d-4bf2-bbc0-25fd8ccf2a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54453c4e-69a5-43a8-bfde-e031b0ad5bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54453c4e-69a5-43a8-bfde-e031b0ad5bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57ab46f-f34c-412c-ac9e-9a1fe9976ed4', 'volume_name': 'volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cc6a33-813c-4bfd-a996-789c03de1ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cc6a33-813c-4bfd-a996-789c03de1ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308ac1c2-a55b-4457-9beb-91be3c513c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:37 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Volume f57ab46f-f34c-412c-ac9e-9a1fe9976ed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4', 'volume_size': 1}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1212632459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57ab46f-f34c-412c-ac9e-9a1fe9976ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fbae69fae04307aa893d01bc14b514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:38Z,use_quota=True,user_id='c42217af044c444f92cc429d12ad323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Creating volume f57ab46f-f34c-412c-ac9e-9a1fe9976ed4 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:19:37 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:19:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:37 devstack sudo[92362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4 1073741824
Sep 29 18:19:37 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:38 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4 1073741824" returned: 0 in 0.975s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Acquiring lock "cinder-1e1d4121-368f-4257-8383-97b1ab197dea-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Lock "cinder-1e1d4121-368f-4257-8383-97b1ab197dea-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:38 devstack sudo[92778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4
Sep 29 18:19:38 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Acquiring lock "cinder-quobyte-1e1d4121-368f-4257-8383-97b1ab197dea" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Lock "cinder-quobyte-1e1d4121-368f-4257-8383-97b1ab197dea" acquired by "delete_volume" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5902b2e4-bfeb-4b46-a0b7-681776f2b42f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:39 devstack sudo[92781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea
Sep 29 18:19:39 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:39 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4" returned: 0 in 0.448s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308ac1c2-a55b-4457-9beb-91be3c513c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c851690-962d-448f-9325-926b93cc9ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:39 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Volume volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4 (f57ab46f-f34c-412c-ac9e-9a1fe9976ed4): created successfully
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c851690-962d-448f-9325-926b93cc9ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Flow 'volume_create_manager' (48d38468-6b78-44e5-809d-b01a62cd7627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:39 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0cee47fd-e213-4e15-b81e-41cb8b2deae2 tempest-ServersNegativeTestJSON-2051811553 None] Created volume successfully.
Sep 29 18:19:39 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea" returned: 0 in 0.649s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:39 devstack sudo[92794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea
Sep 29 18:19:39 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:40 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e1d4121-368f-4257-8383-97b1ab197dea" returned: 0 in 0.409s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Lock "cinder-quobyte-1e1d4121-368f-4257-8383-97b1ab197dea" released by "delete_volume" :: held 1.138s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Created reservations ['db32619a-926b-4f81-ad1a-4628140ed076', 'b581d9d2-c258-4478-959d-738eb8b5617b', 'be7ce211-a748-46b7-92bc-f6da6755945d', '225f0e22-5f3e-4874-b3c6-5e9e1a8fa26d'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:40 devstack sudo[92811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:19:40 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:40 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.401s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:19:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Deleted volume successfully.
Sep 29 18:19:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-acbcbef5-24b4-4db7-8fb0-944856ac0dfc tempest-VolumesActionsTest-314727789 None] Lock "cinder-1e1d4121-368f-4257-8383-97b1ab197dea-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Flow 'volume_create_manager' (45d78ff9-23ca-42f4-94bb-09ba7d68b495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17518e9d-d161-43a9-a8b6-00eeb96d6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17518e9d-d161-43a9-a8b6-00eeb96d6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-159450955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142cf049-ec1a-480c-9d2f-e3fbd6663eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fbae69fae04307aa893d01bc14b514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:42Z,use_quota=True,user_id='c42217af044c444f92cc429d12ad323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9284a76-1b72-4a2a-812f-85ac1b45cbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9284a76-1b72-4a2a-812f-85ac1b45cbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e0ec3c-70d8-4f4c-999d-5db0197208fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e0ec3c-70d8-4f4c-999d-5db0197208fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '142cf049-ec1a-480c-9d2f-e3fbd6663eec', 'volume_name': 'volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0172e1-fb15-433d-b0e9-a418dcf3adfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0172e1-fb15-433d-b0e9-a418dcf3adfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4736ef-c397-4448-8b2f-08f62e82bc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:42 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Volume 142cf049-ec1a-480c-9d2f-e3fbd6663eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec', 'volume_size': 1}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-159450955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142cf049-ec1a-480c-9d2f-e3fbd6663eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fbae69fae04307aa893d01bc14b514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:42Z,use_quota=True,user_id='c42217af044c444f92cc429d12ad323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Creating volume 142cf049-ec1a-480c-9d2f-e3fbd6663eec {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:19:42 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:19:42 devstack sudo[92829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec 1073741824
Sep 29 18:19:42 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (6c8e394a-ea09-4384-9f34-0bdab37b67e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea010d9d-3c5b-42b9-9ba3-2b619254b9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea010d9d-3c5b-42b9-9ba3-2b619254b9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-394347531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82034ceb-dddf-41e1-a412-d4c1b253495a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:42Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7107b5fb-93db-4a51-ac11-90bc5fd638da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7107b5fb-93db-4a51-ac11-90bc5fd638da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80a8959-1111-4d78-aa7b-ece518735cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80a8959-1111-4d78-aa7b-ece518735cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82034ceb-dddf-41e1-a412-d4c1b253495a', 'volume_name': 'volume-82034ceb-dddf-41e1-a412-d4c1b253495a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3695762-979b-4329-bc3f-498296868264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3695762-979b-4329-bc3f-498296868264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d2daa2-b9a0-4ee8-b63f-3a311dac43ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:42 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Volume 82034ceb-dddf-41e1-a412-d4c1b253495a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82034ceb-dddf-41e1-a412-d4c1b253495a', 'volume_size': 1}
Sep 29 18:19:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:43 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec 1073741824" returned: 0 in 0.612s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:43 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec
Sep 29 18:19:43 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:43 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec" returned: 0 in 0.307s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-394347531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82034ceb-dddf-41e1-a412-d4c1b253495a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:42Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Creating volume 82034ceb-dddf-41e1-a412-d4c1b253495a {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:19:43 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4736ef-c397-4448-8b2f-08f62e82bc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c2f728-835c-4fb7-b0a6-70ca5d110349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:43 devstack sudo[92838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a 1073741824
Sep 29 18:19:43 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:43 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Volume volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec (142cf049-ec1a-480c-9d2f-e3fbd6663eec): created successfully
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c2f728-835c-4fb7-b0a6-70ca5d110349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Flow 'volume_create_manager' (45d78ff9-23ca-42f4-94bb-09ba7d68b495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:43 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-52230863-1c36-42fa-87b2-874923a6b9ce tempest-ServersNegativeTestJSON-2051811553 None] Created volume successfully.
Sep 29 18:19:44 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a 1073741824" returned: 0 in 0.931s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:44 devstack sudo[92847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a
Sep 29 18:19:44 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Acquiring lock "cinder-142cf049-ec1a-480c-9d2f-e3fbd6663eec-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Lock "cinder-142cf049-ec1a-480c-9d2f-e3fbd6663eec-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:44 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a" returned: 0 in 0.606s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d2daa2-b9a0-4ee8-b63f-3a311dac43ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82034ceb-dddf-41e1-a412-d4c1b253495a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad932c07-9dfe-4c9a-a420-3632e6cacef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:45 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Volume volume-82034ceb-dddf-41e1-a412-d4c1b253495a (82034ceb-dddf-41e1-a412-d4c1b253495a): created successfully
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad932c07-9dfe-4c9a-a420-3632e6cacef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (6c8e394a-ea09-4384-9f34-0bdab37b67e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Acquiring lock "cinder-quobyte-142cf049-ec1a-480c-9d2f-e3fbd6663eec" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bcda20ec-e704-4dbf-8519-2a9b642eab3b tempest-VolumesActionsTest-1794902551 None] Created volume successfully.
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Lock "cinder-quobyte-142cf049-ec1a-480c-9d2f-e3fbd6663eec" acquired by "delete_volume" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1152b603-4dd9-4adb-aa13-79680e59e837]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:45 devstack sudo[92851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec
Sep 29 18:19:45 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Acquiring lock "cinder-82034ceb-dddf-41e1-a412-d4c1b253495a-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Lock "cinder-82034ceb-dddf-41e1-a412-d4c1b253495a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Acquiring lock "cinder-quobyte-82034ceb-dddf-41e1-a412-d4c1b253495a" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Lock "cinder-quobyte-82034ceb-dddf-41e1-a412-d4c1b253495a" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed8473f-6967-4277-a751-b0d45c9d5f9c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:19:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:45 devstack sudo[92855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a
Sep 29 18:19:45 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:46 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec" returned: 0 in 0.841s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:46 devstack sudo[92859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec
Sep 29 18:19:46 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:46 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a" returned: 0 in 0.767s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:46 devstack sudo[92866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a
Sep 29 18:19:46 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:46 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-142cf049-ec1a-480c-9d2f-e3fbd6663eec" returned: 0 in 0.765s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Lock "cinder-quobyte-142cf049-ec1a-480c-9d2f-e3fbd6663eec" released by "delete_volume" :: held 1.680s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:46 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Created reservations ['f958993f-f249-4c78-b7c1-ad0ee48f0032', '1f847678-703d-4765-971b-e588ac67646b', '0cee3eac-b3ee-43c1-ada1-4e7f5dcf06d1', '078c0002-0f3a-4de4-a2c9-3e3653cff4e7'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:47 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-82034ceb-dddf-41e1-a412-d4c1b253495a" returned: 0 in 0.645s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:47 devstack sudo[92874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:19:47 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Lock "cinder-quobyte-82034ceb-dddf-41e1-a412-d4c1b253495a" released by "delete_volume" :: held 1.501s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Created reservations ['3e12200b-f9d5-4036-b821-d9e143869c59', '04aa33aa-6fcf-4cf1-be5b-9497e2d65139', 'f9dee5a7-5e5a-441e-b695-a4111c58a029', '9091af27-ba73-445f-8e44-8a25bed8fd1c'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Acquiring lock "cinder-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Lock "cinder-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Acquiring lock "cinder-quobyte-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Lock "cinder-quobyte-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4" acquired by "delete_volume" :: waited 0.079s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:47 devstack sudo[92884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:19:47 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:47 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.659s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f27d9e-154f-4a41-b68b-8cedace26b11]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:47 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Deleted volume successfully.
Sep 29 18:19:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d903e8e3-eb64-4756-88c5-caa5505de46b tempest-ServersNegativeTestJSON-2051811553 None] Lock "cinder-142cf049-ec1a-480c-9d2f-e3fbd6663eec-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:48 devstack sudo[92887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4
Sep 29 18:19:48 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:48 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.690s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:48 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:19:48 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Deleted volume successfully.
Sep 29 18:19:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c593107b-31a5-4eb2-84c1-98a3dbee9a50 tempest-VolumesActionsTest-314727789 None] Lock "cinder-82034ceb-dddf-41e1-a412-d4c1b253495a-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:48 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4" returned: 0 in 0.742s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:48 devstack sudo[92900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4
Sep 29 18:19:48 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:49 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4" returned: 0 in 0.595s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Lock "cinder-quobyte-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4" released by "delete_volume" :: held 1.517s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (69137f77-1761-4f3a-8f1c-24acea029669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fa9b87-9ea2-4e33-a19c-a07a247dbca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fa9b87-9ea2-4e33-a19c-a07a247dbca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-655729348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d5bd1b-dacc-45ab-befc-554ebed83570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:49Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3539333c-171f-4f60-aed5-2bf01a2d8565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3539333c-171f-4f60-aed5-2bf01a2d8565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f11129e-5917-4b78-9c10-4818a76fd8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f11129e-5917-4b78-9c10-4818a76fd8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02d5bd1b-dacc-45ab-befc-554ebed83570', 'volume_name': 'volume-02d5bd1b-dacc-45ab-befc-554ebed83570', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40eebc21-6dea-4105-9865-f89cf88840a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40eebc21-6dea-4105-9865-f89cf88840a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c42314-5e8e-4416-9ef8-0d64dbe0dac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:49 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Volume 02d5bd1b-dacc-45ab-befc-554ebed83570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02d5bd1b-dacc-45ab-befc-554ebed83570', 'volume_size': 1}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-655729348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d5bd1b-dacc-45ab-befc-554ebed83570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:49Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Creating volume 02d5bd1b-dacc-45ab-befc-554ebed83570 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:19:49 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:49 devstack sudo[92903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570 1073741824
Sep 29 18:19:49 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Created reservations ['b4b1909a-f9b9-419f-b5e1-b95f9b5b68b3', '483f5ae2-1809-49e3-ad60-ffb1ce5598ef', '0196102a-db50-45d9-b455-9928755ced53', '3ee7698f-e347-47ca-b139-093c72803b4c'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:49 devstack sudo[92905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:19:49 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:50 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.421s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:50 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:19:50 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Deleted volume successfully.
Sep 29 18:19:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d59f952-0d76-40df-9995-231acd5fe402 tempest-ServersNegativeTestJSON-2051811553 None] Lock "cinder-f57ab46f-f34c-412c-ac9e-9a1fe9976ed4-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:50 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570 1073741824" returned: 0 in 0.965s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:50 devstack sudo[92913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570
Sep 29 18:19:50 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:51 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570" returned: 0 in 0.623s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:19:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c42314-5e8e-4416-9ef8-0d64dbe0dac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02d5bd1b-dacc-45ab-befc-554ebed83570', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e0ea1e-85fd-47d8-ab39-70a5890cba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:51 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Volume volume-02d5bd1b-dacc-45ab-befc-554ebed83570 (02d5bd1b-dacc-45ab-befc-554ebed83570): created successfully
Sep 29 18:19:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e0ea1e-85fd-47d8-ab39-70a5890cba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (69137f77-1761-4f3a-8f1c-24acea029669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:51 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f6ca154d-689b-40ca-aca4-b688b81e979b tempest-VolumesActionsTest-1794902551 None] Created volume successfully.
Sep 29 18:19:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Acquiring lock "cinder-02d5bd1b-dacc-45ab-befc-554ebed83570-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Lock "cinder-02d5bd1b-dacc-45ab-befc-554ebed83570-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Acquiring lock "cinder-quobyte-02d5bd1b-dacc-45ab-befc-554ebed83570" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:19:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Lock "cinder-quobyte-02d5bd1b-dacc-45ab-befc-554ebed83570" acquired by "delete_volume" :: waited 0.043s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:19:53 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf79f4b-242b-4ca8-a92c-055c7965f581]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:19:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:53 devstack sudo[92947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570
Sep 29 18:19:53 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:53 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570" returned: 0 in 0.663s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:53 devstack sudo[92953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570
Sep 29 18:19:53 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:19:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:54 devstack sudo[92957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:19:54 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:54 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-02d5bd1b-dacc-45ab-befc-554ebed83570" returned: 0 in 0.659s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Lock "cinder-quobyte-02d5bd1b-dacc-45ab-befc-554ebed83570" released by "delete_volume" :: held 1.426s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:54 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Created reservations ['8b48dd63-693c-43b9-a94c-f3181c5c2c7d', 'cabedd01-f3e2-4c80-8a84-fb3226848b2c', '664a7a1f-978a-4e62-ba3c-1ef72d9b2161', '97fbd167-d6de-4b61-ba61-3ab8c69aa4b7'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:19:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:55 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.848s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:55 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:19:55 devstack sudo[92976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:19:55 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:55 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:19:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:19:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:19:56 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 1.021s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:56 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:19:56 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Deleted volume successfully.
Sep 29 18:19:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4d7a3408-8df0-42a6-8a9f-b7c688e67661 tempest-VolumesActionsTest-314727789 None] Lock "cinder-02d5bd1b-dacc-45ab-befc-554ebed83570-delete_volume" released by "delete_volume" :: held 3.444s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (78727aaf-35d9-4300-9c9c-fb0d9a7795b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29acaa2d-cb4a-4186-88ff-35c5970e2c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29acaa2d-cb4a-4186-88ff-35c5970e2c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1664760188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e280141-2828-4afb-8730-a58675af4b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:57Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188d49d3-52b6-42d7-bf30-450e8ad686d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188d49d3-52b6-42d7-bf30-450e8ad686d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637cfacd-2947-419f-95d4-6ced88be1c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637cfacd-2947-419f-95d4-6ced88be1c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e280141-2828-4afb-8730-a58675af4b75', 'volume_name': 'volume-1e280141-2828-4afb-8730-a58675af4b75', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e99538-f57c-471d-8a0f-c1f0c9560e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e99538-f57c-471d-8a0f-c1f0c9560e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995c961b-f992-40fe-a9f6-62f43cb24f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:57 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Volume 1e280141-2828-4afb-8730-a58675af4b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e280141-2828-4afb-8730-a58675af4b75', 'volume_size': 1}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1664760188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e280141-2828-4afb-8730-a58675af4b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c647a80e904a1b933c0b28863a2114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:57Z,use_quota=True,user_id='508139a79f7f4185b669ec96d5f02544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Creating volume 1e280141-2828-4afb-8730-a58675af4b75 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:19:57 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:19:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:57 devstack sudo[93045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75 1073741824
Sep 29 18:19:57 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:58 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75 1073741824" returned: 0 in 0.881s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:19:58 devstack sudo[93099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75
Sep 29 18:19:58 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:19:59 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-eba911c4-aea7-49be-9b80-852eb05ccc07 req-33e53632-70f7-40a0-88ca-c134d7bf05f8 tempest-ServerActionsTestOtherA-1570517160 None] Terminate volume connection completed successfully.
Sep 29 18:19:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-eba911c4-aea7-49be-9b80-852eb05ccc07 req-33e53632-70f7-40a0-88ca-c134d7bf05f8 tempest-ServerActionsTestOtherA-1570517160 None] Deleting attachment 8c2c01b4-3e73-4ea1-87ab-978d4e5c880a. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:19:59 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root
Sep 29 18:19:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75" returned: 0 in 0.833s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:19:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:19:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:19:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995c961b-f992-40fe-a9f6-62f43cb24f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e280141-2828-4afb-8730-a58675af4b75', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02deb362-35a7-4dce-8cd9-1e2f99eafb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:19:59 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Volume volume-1e280141-2828-4afb-8730-a58675af4b75 (1e280141-2828-4afb-8730-a58675af4b75): created successfully
Sep 29 18:19:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02deb362-35a7-4dce-8cd9-1e2f99eafb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:19:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Flow 'volume_create_manager' (78727aaf-35d9-4300-9c9c-fb0d9a7795b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:19:59 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-b9e3c48f-22ee-4532-9acf-b41737d22af2 tempest-VolumesActionsTest-1794902551 None] Created volume successfully.
Sep 29 18:20:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "cinder-1e280141-2828-4afb-8730-a58675af4b75-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Lock "cinder-1e280141-2828-4afb-8730-a58675af4b75-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "cinder-quobyte-1e280141-2828-4afb-8730-a58675af4b75" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Lock "cinder-quobyte-1e280141-2828-4afb-8730-a58675af4b75" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:01 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1e95e3-0fcf-4059-a391-c5ec51ea3fdf]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:01 devstack sudo[93107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75
Sep 29 18:20:01 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:02 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75" returned: 0 in 0.553s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:02 devstack sudo[93115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75
Sep 29 18:20:02 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:02 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1e280141-2828-4afb-8730-a58675af4b75" returned: 0 in 0.445s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Lock "cinder-quobyte-1e280141-2828-4afb-8730-a58675af4b75" released by "delete_volume" :: held 1.070s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:02 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Created reservations ['65f43d65-2915-4357-bc9b-85ee3bfd50e9', 'defaafb2-2be6-483b-8af6-87a271825dab', 'e7ef2961-75da-4b86-a444-972ce390012f', '840cc65c-3686-4826-b5f3-d3fcae8280c7'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:20:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:03 devstack sudo[93118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:20:03 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:03 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.337s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:03 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:20:03 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Deleted volume successfully.
Sep 29 18:20:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8e1d49bc-7678-47c7-b879-558e6cbffc81 tempest-VolumesActionsTest-1794902551 None] Lock "cinder-1e280141-2828-4afb-8730-a58675af4b75-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-eba911c4-aea7-49be-9b80-852eb05ccc07 req-3638c5ff-44b8-4458-9fab-e0c973ff7920 tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-eba911c4-aea7-49be-9b80-852eb05ccc07 req-3638c5ff-44b8-4458-9fab-e0c973ff7920 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-eba911c4-aea7-49be-9b80-852eb05ccc07 req-3638c5ff-44b8-4458-9fab-e0c973ff7920 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-eba911c4-aea7-49be-9b80-852eb05ccc07 req-3638c5ff-44b8-4458-9fab-e0c973ff7920 tempest-ServerActionsTestOtherA-1570517160 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-9730cd46-d582-4588-a0b5-2db892452e00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbb23ade-c6bc-4ca1-830e-7c04cb96d215', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:20:03 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-eba911c4-aea7-49be-9b80-852eb05ccc07 req-3638c5ff-44b8-4458-9fab-e0c973ff7920 tempest-ServerActionsTestOtherA-1570517160 None] attachment_update completed successfully.
Sep 29 18:20:11 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=92,cinder:SELECT=90,cinder:DELETE=11,cinder:INSERT=29 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:20:11 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=85,cinder:UPDATE=107,cinder:INSERT=27,cinder:DELETE=6 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:20:18 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e42dd61b-a888-4671-b397-55f77a126162 tempest-GroupSnapshotsV319Test-233173380 None] Group tempest-GroupSnapshotsV319Test-Group-159205099: creating
Sep 29 18:20:18 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e42dd61b-a888-4671-b397-55f77a126162 tempest-GroupSnapshotsV319Test-233173380 None] Group tempest-GroupSnapshotsV319Test-Group-159205099: created successfully
Sep 29 18:20:18 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e42dd61b-a888-4671-b397-55f77a126162 tempest-GroupSnapshotsV319Test-233173380 None] Create group completed successfully.
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Flow 'volume_create_manager' (ddab4363-04be-459d-8db0-68820cd8dc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabe0bc1-1f63-46c7-8cc3-15a84fb7903d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabe0bc1-1f63-46c7-8cc3-15a84fb7903d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1593363385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb51f493-a3d7-4488-82c3-0588e53128bc,host='devstack@QuobyteHD#QuobyteHD',id=39ef0d0d-cf58-4c38-a64e-ab92ca40befb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1852ccd64c0c4f369c3b052f4c0b32af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:21Z,use_quota=True,user_id='dab1e90a9c8349bbaf0b74e338ece16b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dc6059a-112b-4dd3-a3f5-ef95e93549b4),volume_type_id=8dc6059a-112b-4dd3-a3f5-ef95e93549b4)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2245089-8448-40e3-b4ac-8dafd5bc9317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2245089-8448-40e3-b4ac-8dafd5bc9317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbe1ecb-8272-4ae0-ba83-102682f74366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbe1ecb-8272-4ae0-ba83-102682f74366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ef0d0d-cf58-4c38-a64e-ab92ca40befb', 'volume_name': 'volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66522f22-783b-48eb-a26b-756f56ebb860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66522f22-783b-48eb-a26b-756f56ebb860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604d3cc6-f6ea-433b-8113-4655790b6d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:20 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Volume 39ef0d0d-cf58-4c38-a64e-ab92ca40befb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb', 'volume_size': 1}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eb51f493-a3d7-4488-82c3-0588e53128bc,created_at=2026-09-29T16:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1593363385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb51f493-a3d7-4488-82c3-0588e53128bc,host='devstack@QuobyteHD#QuobyteHD',id=39ef0d0d-cf58-4c38-a64e-ab92ca40befb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1852ccd64c0c4f369c3b052f4c0b32af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:21Z,use_quota=True,user_id='dab1e90a9c8349bbaf0b74e338ece16b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dc6059a-112b-4dd3-a3f5-ef95e93549b4),volume_type_id=8dc6059a-112b-4dd3-a3f5-ef95e93549b4)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Creating volume 39ef0d0d-cf58-4c38-a64e-ab92ca40befb {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:20:20 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:20:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:20 devstack sudo[93689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb 1073741824
Sep 29 18:20:20 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:21 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb 1073741824" returned: 0 in 0.529s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:21 devstack sudo[93695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb
Sep 29 18:20:21 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:21 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb" returned: 0 in 0.545s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:20:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604d3cc6-f6ea-433b-8113-4655790b6d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acef064e-5ebb-4450-957d-5cd8430f0ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:22 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Volume volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb (39ef0d0d-cf58-4c38-a64e-ab92ca40befb): created successfully
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acef064e-5ebb-4450-957d-5cd8430f0ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Flow 'volume_create_manager' (ddab4363-04be-459d-8db0-68820cd8dc46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:20:22 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5350b551-1d9f-4604-8dc0-37178fe7c4f9 tempest-GroupSnapshotsV319Test-233173380 None] Created volume successfully.
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Flow 'volume_create_manager' (f5dbbd28-d4da-48f0-9f6e-99a3a2389310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a28f2f-5a29-4a7d-a9eb-a3a62671bad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a28f2f-5a29-4a7d-a9eb-a3a62671bad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1019305908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f347b04b-1dcb-453f-aaa0-247e87f1ea08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bc5b1a694f45afa7ff222e65c7ab02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:23Z,use_quota=True,user_id='2ec9fb06faf34e97a96a48ae0d00493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32944cf-967e-450d-9b8d-953d0aeca8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32944cf-967e-450d-9b8d-953d0aeca8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36230b4-2661-4df8-b45d-4e03f99a7c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36230b4-2661-4df8-b45d-4e03f99a7c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f347b04b-1dcb-453f-aaa0-247e87f1ea08', 'volume_name': 'volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac9e411-d13f-43d0-acf9-8899dca882aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac9e411-d13f-43d0-acf9-8899dca882aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd02956c-12f5-40f4-8cad-6f25c7b7d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:22 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Volume f347b04b-1dcb-453f-aaa0-247e87f1ea08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08', 'volume_size': 1}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1019305908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f347b04b-1dcb-453f-aaa0-247e87f1ea08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bc5b1a694f45afa7ff222e65c7ab02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:23Z,use_quota=True,user_id='2ec9fb06faf34e97a96a48ae0d00493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Creating volume f347b04b-1dcb-453f-aaa0-247e87f1ea08 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:20:22 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:20:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:22 devstack sudo[93701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08 1073741824
Sep 29 18:20:22 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:23 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08 1073741824" returned: 0 in 0.617s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:23 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] GroupSnapshot e6c926b5-b2ca-44ac-83e6-292c93d3a197: creating.
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] Group snapshot e6c926b5-b2ca-44ac-83e6-292c93d3a197: creating. {{(pid=86821) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:23 devstack sudo[93707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08
Sep 29 18:20:23 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:23 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08" returned: 0 in 0.320s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.286s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd02956c-12f5-40f4-8cad-6f25c7b7d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ad9fd6-d48c-4ee6-ad61-ce46a6fa65e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] Creating offline snapshot 9a673c70-d781-4f93-817b-e43cf4aee386 of volume 39ef0d0d-cf58-4c38-a64e-ab92ca40befb {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:20:23 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Volume volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08 (f347b04b-1dcb-453f-aaa0-247e87f1ea08): created successfully
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ad9fd6-d48c-4ee6-ad61-ce46a6fa65e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Flow 'volume_create_manager' (f5dbbd28-d4da-48f0-9f6e-99a3a2389310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed5961d-20e0-4474-b43e-5d389ddd4e61]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:23 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e3ba4163-2c8c-4433-9efd-703d74a92ae7 tempest-AttachVolumeNegativeTest-103688396 None] Created volume successfully.
Sep 29 18:20:24 devstack sudo[93710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb
Sep 29 18:20:24 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:24 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb" returned: 0 in 0.427s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:24 devstack sudo[93739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386 1G
Sep 29 18:20:24 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:24 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386 1G" returned: 0 in 0.515s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:24 devstack sudo[93745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386
Sep 29 18:20:24 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:25 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386" returned: 0 in 0.402s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:25 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386 is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:20:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:25 devstack sudo[93754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386
Sep 29 18:20:25 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:25 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386" returned: 0 in 0.493s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:25 devstack sudo[93763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.info
Sep 29 18:20:25 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-d11e8518-aa4f-4180-a28e-62b6e6f2f89b req-7d12d9a2-8076-4fd8-bc52-19b1de694d19 tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:26 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.info" returned: 0 in 0.362s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:26 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:20:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:26 devstack sudo[93774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.info
Sep 29 18:20:26 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:26 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.info" returned: 0 in 0.288s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.638s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-d11e8518-aa4f-4180-a28e-62b6e6f2f89b req-7d12d9a2-8076-4fd8-bc52-19b1de694d19 tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.345s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-d11e8518-aa4f-4180-a28e-62b6e6f2f89b req-7d12d9a2-8076-4fd8-bc52-19b1de694d19 tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-d11e8518-aa4f-4180-a28e-62b6e6f2f89b req-7d12d9a2-8076-4fd8-bc52-19b1de694d19 tempest-AttachVolumeNegativeTest-103688396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5a68245-177f-4cdd-ae14-5c2309215e56', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:20:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-059912a6-5cdf-458d-bc05-1d60853a7299 tempest-GroupSnapshotsV319Test-233173380 None] group_snapshot e6c926b5-b2ca-44ac-83e6-292c93d3a197: created successfully
Sep 29 18:20:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-d11e8518-aa4f-4180-a28e-62b6e6f2f89b req-7d12d9a2-8076-4fd8-bc52-19b1de694d19 tempest-AttachVolumeNegativeTest-103688396 None] attachment_update completed successfully.
Sep 29 18:20:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] group_snapshot e6c926b5-b2ca-44ac-83e6-292c93d3a197: deleting
Sep 29 18:20:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] group_snapshot e6c926b5-b2ca-44ac-83e6-292c93d3a197: deleting {{(pid=86821) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 29 18:20:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Acquiring lock "cinder-quobyte-39ef0d0d-cf58-4c38-a64e-ab92ca40befb" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Lock "cinder-quobyte-39ef0d0d-cf58-4c38-a64e-ab92ca40befb" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Acquiring lock "cinder-quobyte-9a673c70-d781-4f93-817b-e43cf4aee386" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Lock "cinder-quobyte-9a673c70-d781-4f93-817b-e43cf4aee386" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Deleting offline snapshot 9a673c70-d781-4f93-817b-e43cf4aee386 of volume 39ef0d0d-cf58-4c38-a64e-ab92ca40befb {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:20:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] snapshot_file for this snap is: volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:20:27 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a61047-f7a3-4064-ad8d-fa61d714e86c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:27 devstack sudo[93794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386
Sep 29 18:20:27 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:28 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386" returned: 0 in 0.523s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:20:28 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[27889fbe-c733-4714-8197-5ce746aa70f2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:28 devstack sudo[93799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb
Sep 29 18:20:28 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:28 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb" returned: 0 in 0.377s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:28 devstack sudo[93804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386
Sep 29 18:20:28 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:28 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386" returned: 0 in 0.386s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:28 devstack sudo[93810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386
Sep 29 18:20:28 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:29 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb.9a673c70-d781-4f93-817b-e43cf4aee386" returned: 0 in 0.263s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Lock "cinder-quobyte-9a673c70-d781-4f93-817b-e43cf4aee386" released by "_delete_snapshot" :: held 1.716s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Lock "cinder-quobyte-39ef0d0d-cf58-4c38-a64e-ab92ca40befb" released by "delete_snapshot" :: held 1.763s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:29 devstack cinder-volume[86821]: WARNING cinder.quota [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1466227813 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1466227813, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:20:29 devstack cinder-volume[86821]: WARNING cinder.quota [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1466227813 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1466227813, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] Created reservations ['74acd255-e038-4770-b225-20fdcaa54c72', '3d583fcc-3635-488b-a673-e4f9b4b77b27', 'f667ed98-1c1c-4254-874d-8d6bd99f6f4b', '856f6c6a-c88a-4274-a6ee-7b54741d0483'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:20:29 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d300841c-d1d4-4d52-a9c2-980c88148495 tempest-GroupSnapshotsV319Test-233173380 None] group_snapshot e6c926b5-b2ca-44ac-83e6-292c93d3a197: deleted successfully
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Flow 'volume_create_manager' (b9d2e3b5-2122-4948-922b-3f54c9dc8bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0dbb38-fdb5-40cd-ba64-5576bac7ec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0dbb38-fdb5-40cd-ba64-5576bac7ec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-749978654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3f4d33-0898-4e16-a354-2a717c2fe613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9142698ccc458480f5dd9a458e0933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:30Z,use_quota=True,user_id='2bab0206b4954e2892badb69f8ea1fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c348923-a74f-4b4f-b665-4f809db38952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c348923-a74f-4b4f-b665-4f809db38952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8761af9c-0b51-46cd-a585-7e47f2aebb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8761af9c-0b51-46cd-a585-7e47f2aebb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b3f4d33-0898-4e16-a354-2a717c2fe613', 'volume_name': 'volume-7b3f4d33-0898-4e16-a354-2a717c2fe613', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576c8fa9-8ac7-4615-9103-45fb98d4778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576c8fa9-8ac7-4615-9103-45fb98d4778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03660ae-22c1-436d-a9d3-e1d0ab2b74b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:29 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Volume 7b3f4d33-0898-4e16-a354-2a717c2fe613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b3f4d33-0898-4e16-a354-2a717c2fe613', 'volume_size': 1}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-749978654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3f4d33-0898-4e16-a354-2a717c2fe613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9142698ccc458480f5dd9a458e0933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:30Z,use_quota=True,user_id='2bab0206b4954e2892badb69f8ea1fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Creating volume 7b3f4d33-0898-4e16-a354-2a717c2fe613 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:20:29 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:20:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:30 devstack sudo[93819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613 1073741824
Sep 29 18:20:30 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Acquiring lock "cinder-quobyte-39ef0d0d-cf58-4c38-a64e-ab92ca40befb" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Lock "cinder-quobyte-39ef0d0d-cf58-4c38-a64e-ab92ca40befb" acquired by "delete_volume" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96b648f-413b-419b-856b-460d8d785f17]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:30 devstack sudo[93821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb
Sep 29 18:20:30 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:30 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613 1073741824" returned: 0 in 0.511s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:30 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb" returned: 0 in 0.411s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:30 devstack sudo[93829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb
Sep 29 18:20:30 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:30 devstack sudo[93830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613
Sep 29 18:20:30 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:30 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-39ef0d0d-cf58-4c38-a64e-ab92ca40befb" returned: 0 in 0.285s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:30 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613" returned: 0 in 0.278s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Lock "cinder-quobyte-39ef0d0d-cf58-4c38-a64e-ab92ca40befb" released by "delete_volume" :: held 0.789s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03660ae-22c1-436d-a9d3-e1d0ab2b74b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3f4d33-0898-4e16-a354-2a717c2fe613', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e522dc-2280-4b6f-ba3a-c56951ffaff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:30 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Volume volume-7b3f4d33-0898-4e16-a354-2a717c2fe613 (7b3f4d33-0898-4e16-a354-2a717c2fe613): created successfully
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e522dc-2280-4b6f-ba3a-c56951ffaff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Flow 'volume_create_manager' (b9d2e3b5-2122-4948-922b-3f54c9dc8bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:20:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bd98f409-bf56-4084-9256-76682f5ef1a6 tempest-AbsoluteLimitsTests-735846449 None] Created volume successfully.
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Created reservations ['5de2dea1-b40a-47bd-bec1-e15de94bb5c6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:20:30 devstack cinder-volume[86821]: WARNING cinder.quota [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1466227813 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1466227813, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:20:30 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Created reservations ['bb0e74f1-95d5-4acf-8840-724b7846a985', 'f2cea3d5-4b5d-432a-b59a-b7b595740657', 'e507204e-084d-4113-a63c-34c4263ab1a2', '47ccb783-6b17-4580-8771-fbe1dd602d16'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:20:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:31 devstack sudo[93835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:20:31 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:31 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.259s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:31 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:20:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-598da42f-e011-431e-a37d-73a43c980744 tempest-GroupSnapshotsV319Test-233173380 None] Delete group completed successfully.
Sep 29 18:20:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Acquiring lock "cinder-7b3f4d33-0898-4e16-a354-2a717c2fe613-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Lock "cinder-7b3f4d33-0898-4e16-a354-2a717c2fe613-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Acquiring lock "cinder-quobyte-7b3f4d33-0898-4e16-a354-2a717c2fe613" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Lock "cinder-quobyte-7b3f4d33-0898-4e16-a354-2a717c2fe613" acquired by "delete_volume" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:32 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28da6cd-e524-4d76-9ac5-c716dd9e517f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:32 devstack sudo[93840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613
Sep 29 18:20:32 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:32 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613" returned: 0 in 0.449s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:33 devstack sudo[93845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613
Sep 29 18:20:33 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:33 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7b3f4d33-0898-4e16-a354-2a717c2fe613" returned: 0 in 0.343s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Lock "cinder-quobyte-7b3f4d33-0898-4e16-a354-2a717c2fe613" released by "delete_volume" :: held 0.853s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Created reservations ['c38c08e8-e5bd-4738-b8b7-ba56b5aaf977', '04319b61-ecef-4138-839d-50305a6384b8', '2b43297c-6af6-4b0f-9859-075a451f3bfb', 'f70edf67-7e57-490b-8657-7ddab97cf55b'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:33 devstack sudo[93851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:20:33 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:33 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.356s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:20:33 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Deleted volume successfully.
Sep 29 18:20:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-467a9e58-0461-4dcf-ba76-9765aa368d46 tempest-AbsoluteLimitsTests-735846449 None] Lock "cinder-7b3f4d33-0898-4e16-a354-2a717c2fe613-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Flow 'volume_create_manager' (81bc7c2e-dc45-442c-b891-ffdb23b9a09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddbbefe-600c-4ea1-ba09-85a981045af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddbbefe-600c-4ea1-ba09-85a981045af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-764266374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f543a36-a00d-48e7-9604-403ce0682c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7129042bbd4393aa21bf800200c3e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:40Z,use_quota=True,user_id='410392b84e414dfcadb5bec13f72cf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2a0a21-0743-476a-b482-161e9c182619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2a0a21-0743-476a-b482-161e9c182619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bea4be-0332-45b0-90eb-8cb4fb8a2674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bea4be-0332-45b0-90eb-8cb4fb8a2674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f543a36-a00d-48e7-9604-403ce0682c9c', 'volume_name': 'volume-6f543a36-a00d-48e7-9604-403ce0682c9c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d56fb76-2e29-4b8a-8398-d814d67a6613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d56fb76-2e29-4b8a-8398-d814d67a6613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb18e51-c42e-4bbf-91f6-ff8eeba6f679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:40 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Volume 6f543a36-a00d-48e7-9604-403ce0682c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f543a36-a00d-48e7-9604-403ce0682c9c', 'volume_size': 1}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-764266374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f543a36-a00d-48e7-9604-403ce0682c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7129042bbd4393aa21bf800200c3e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:40Z,use_quota=True,user_id='410392b84e414dfcadb5bec13f72cf8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Creating volume 6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:20:40 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:20:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:40 devstack sudo[93922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c 1073741824
Sep 29 18:20:40 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:41 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c 1073741824" returned: 0 in 0.820s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:41 devstack sudo[93954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c
Sep 29 18:20:41 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:41 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c" returned: 0 in 0.553s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:20:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb18e51-c42e-4bbf-91f6-ff8eeba6f679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f543a36-a00d-48e7-9604-403ce0682c9c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42a06d6-3daa-4243-8f37-dab06b2db69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:41 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Volume volume-6f543a36-a00d-48e7-9604-403ce0682c9c (6f543a36-a00d-48e7-9604-403ce0682c9c): created successfully
Sep 29 18:20:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42a06d6-3daa-4243-8f37-dab06b2db69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Flow 'volume_create_manager' (81bc7c2e-dc45-442c-b891-ffdb23b9a09b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:20:41 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d86d8f41-6ae9-4727-b58d-1d0ce60235fe tempest-SnapshotsActionsTest-808030137 None] Created volume successfully.
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Flow 'volume_create_manager' (3d622164-43e4-4aab-8bc5-587b3545ee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09206f0a-031e-48e0-9c76-c0f021b34398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09206f0a-031e-48e0-9c76-c0f021b34398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-535589604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc020fa-d28d-4937-b079-523332940968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757a37551ac34af5bfef919452b9e9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:43Z,use_quota=True,user_id='9bb6b774460548139bb7b4f220c7fb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c916dbed-f507-453a-b947-b7dce95b174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c916dbed-f507-453a-b947-b7dce95b174c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00c9d56-e82a-48e9-9e62-818b15a08a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00c9d56-e82a-48e9-9e62-818b15a08a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc020fa-d28d-4937-b079-523332940968', 'volume_name': 'volume-7cc020fa-d28d-4937-b079-523332940968', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c17c8f4-8935-44ed-8db3-e47789bac2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c17c8f4-8935-44ed-8db3-e47789bac2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c56a48-f83c-4b17-9a96-c82800985e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:43 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Volume 7cc020fa-d28d-4937-b079-523332940968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc020fa-d28d-4937-b079-523332940968', 'volume_size': 1}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] Creating offline snapshot bf5856d9-82f5-4af9-b563-3f30d5ebf079 of volume 6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f2aaad-80de-420e-997f-18ec9e8b2d65]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:43 devstack sudo[93977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c
Sep 29 18:20:43 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:43 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-e753b66b-a689-4913-aed8-79e9e21763ac tempest-ServerActionsTestOtherA-1570517160 None] Terminate volume connection completed successfully.
Sep 29 18:20:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-e753b66b-a689-4913-aed8-79e9e21763ac tempest-ServerActionsTestOtherA-1570517160 None] Deleting attachment fbb23ade-c6bc-4ca1-830e-7c04cb96d215. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:20:44 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c" returned: 0 in 0.757s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:44 devstack sudo[93983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 1G
Sep 29 18:20:44 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "cinder-9730cd46-d582-4588-a0b5-2db892452e00-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Lock "cinder-9730cd46-d582-4588-a0b5-2db892452e00-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "cinder-quobyte-9730cd46-d582-4588-a0b5-2db892452e00" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Lock "cinder-quobyte-9730cd46-d582-4588-a0b5-2db892452e00" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cff353-ce88-4a73-8573-34044d1dd36f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:44 devstack sudo[93985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00
Sep 29 18:20:44 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:44 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 1G" returned: 0 in 0.756s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:44 devstack sudo[93993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:20:44 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:44 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00" returned: 0 in 0.562s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:45 devstack sudo[93997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00
Sep 29 18:20:45 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:45 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.522s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:45 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 is being set with open permissions: ugo+rw
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:45 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9730cd46-d582-4588-a0b5-2db892452e00" returned: 0 in 0.430s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "cinder-f64bf0f4-3820-4dcf-b4a8-38d81613dea6-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:45 devstack sudo[94003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:20:45 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Lock "cinder-quobyte-9730cd46-d582-4588-a0b5-2db892452e00" released by "delete_volume" :: held 1.094s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Lock "cinder-f64bf0f4-3820-4dcf-b4a8-38d81613dea6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "cinder-quobyte-f64bf0f4-3820-4dcf-b4a8-38d81613dea6" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Lock "cinder-quobyte-f64bf0f4-3820-4dcf-b4a8-38d81613dea6" acquired by "delete_volume" :: waited 0.038s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG cinder.quota [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Created reservations ['30787aa8-b525-4869-afb2-6979a46843a2', 'd9ea0938-6013-44ce-921c-6b68d576155d', '72b11716-d6dc-4933-8908-08dd0f49a1ed', '63fded87-24c1-4196-8099-7a330157b35e'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d59b403-7751-42c2-9698-01b79e3cdd8e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:45 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.382s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:45 devstack sudo[94005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6
Sep 29 18:20:45 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:45 devstack sudo[94008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:20:45 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:45 devstack sudo[94009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.info
Sep 29 18:20:45 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:46 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.396s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG cinder.manager [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:20:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Deleted volume successfully.
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-9443aace-1c21-4fab-b6a2-84efacbec052 req-1dc24643-9034-4d6a-990c-95d0634ea375 tempest-ServerActionsTestOtherA-1570517160 None] Lock "cinder-9730cd46-d582-4588-a0b5-2db892452e00-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:46 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6" returned: 0 in 0.691s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:46 devstack sudo[94018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6
Sep 29 18:20:46 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:46 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.info" returned: 0 in 0.579s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:46 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.info is being set with open permissions: ugo+rw
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:46 devstack sudo[94020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.info
Sep 29 18:20:46 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:46 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f64bf0f4-3820-4dcf-b4a8-38d81613dea6" returned: 0 in 0.360s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Lock "cinder-quobyte-f64bf0f4-3820-4dcf-b4a8-38d81613dea6" released by "delete_volume" :: held 1.114s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Created reservations ['9f6165f3-45f8-42df-8fb6-a0d335b1c377', 'ec0c76ff-f7e6-4963-8adf-1237a0e48d3a', 'c895de85-baad-4d95-aed3-64fca15adcf4', '214d578f-5f04-4357-a1db-2c19fd6813b0'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:20:46 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.info" returned: 0 in 0.392s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.589s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.519s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-535589604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc020fa-d28d-4937-b079-523332940968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757a37551ac34af5bfef919452b9e9ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:43Z,use_quota=True,user_id='9bb6b774460548139bb7b4f220c7fb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Creating volume 7cc020fa-d28d-4937-b079-523332940968 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:20:46 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:46 devstack sudo[94025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968 1073741824
Sep 29 18:20:46 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-957e62ec-a4f0-4ac0-920a-bbb2a93fb928 tempest-SnapshotsActionsTest-808030137 None] Create snapshot completed successfully
Sep 29 18:20:46 devstack sudo[94027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:20:46 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:47 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.344s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:20:47 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Deleted volume successfully.
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1717dc3b-c918-4581-9048-02fd062230e9 tempest-ServerActionsTestOtherA-1570517160 None] Lock "cinder-f64bf0f4-3820-4dcf-b4a8-38d81613dea6-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:47 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968 1073741824" returned: 0 in 0.559s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:47 devstack sudo[94034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968
Sep 29 18:20:47 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:47 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968" returned: 0 in 0.360s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c56a48-f83c-4b17-9a96-c82800985e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc020fa-d28d-4937-b079-523332940968', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d2071d-730e-4950-9ac2-db380aedc2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:47 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Volume volume-7cc020fa-d28d-4937-b079-523332940968 (7cc020fa-d28d-4937-b079-523332940968): created successfully
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d2071d-730e-4950-9ac2-db380aedc2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Flow 'volume_create_manager' (3d622164-43e4-4aab-8bc5-587b3545ee79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:20:47 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-b6bb7392-58d1-4f3d-a6e6-eef817f0564a tempest-VolumesMetadataTest-608258098 None] Created volume successfully.
Sep 29 18:20:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] Creating offline snapshot b9164f4b-f123-45e2-8133-6f75ee36cc21 of volume 6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:20:48 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[23297930-496b-4dbc-bea5-d555a570090e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:48 devstack sudo[94043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:20:48 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:49 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.804s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:20:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:49 devstack sudo[94068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21 1G
Sep 29 18:20:49 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:49 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21 1G" returned: 0 in 0.814s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:50 devstack sudo[94075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21
Sep 29 18:20:50 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Acquiring lock "cinder-7cc020fa-d28d-4937-b079-523332940968-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Lock "cinder-7cc020fa-d28d-4937-b079-523332940968-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Acquiring lock "cinder-quobyte-7cc020fa-d28d-4937-b079-523332940968" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Lock "cinder-quobyte-7cc020fa-d28d-4937-b079-523332940968" acquired by "delete_volume" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5261e3be-e436-40bf-b82a-104dd15b8060]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:50 devstack sudo[94078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968
Sep 29 18:20:50 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:50 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21" returned: 0 in 0.501s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:50 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21 is being set with open permissions: ugo+rw
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:50 devstack sudo[94083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21
Sep 29 18:20:50 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:50 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968" returned: 0 in 0.481s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:50 devstack sudo[94088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968
Sep 29 18:20:50 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:50 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21" returned: 0 in 0.378s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:51 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-96337c67-01b0-4290-aa6b-82bc83e7b0ba tempest-SnapshotsActionsTest-808030137 None] Create snapshot completed successfully
Sep 29 18:20:51 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7cc020fa-d28d-4937-b079-523332940968" returned: 0 in 0.387s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Lock "cinder-quobyte-7cc020fa-d28d-4937-b079-523332940968" released by "delete_volume" :: held 0.964s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Created reservations ['205955ec-9643-49d8-ada0-87086f773130', '594d87a6-1838-4f88-b04c-00f135e0e300', 'c8a52d12-935d-4a77-a5d4-09a686f4ba58', 'd91de47c-c2a8-4a1f-b908-fd0a3b54ca13'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:51 devstack sudo[94092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:20:51 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:51 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.293s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:20:51 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Deleted volume successfully.
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac422d00-3a2f-4a57-b9bc-794b96f34b85 tempest-VolumesMetadataTest-608258098 None] Lock "cinder-7cc020fa-d28d-4937-b079-523332940968-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-b9164f4b-f123-45e2-8133-6f75ee36cc21-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-b9164f4b-f123-45e2-8133-6f75ee36cc21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-quobyte-b9164f4b-f123-45e2-8133-6f75ee36cc21" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-b9164f4b-f123-45e2-8133-6f75ee36cc21" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Deleting offline snapshot b9164f4b-f123-45e2-8133-6f75ee36cc21 of volume 6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] snapshot_file for this snap is: volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb6eb7e-53bb-4069-aea1-ab9d7045e02b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:51 devstack sudo[94095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21
Sep 29 18:20:51 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:52 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21" returned: 0 in 0.396s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:20:52 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcdf7ba-18d4-4765-8218-0174f914e6fd]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:52 devstack sudo[94101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:20:52 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:52 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.522s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:20:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:52 devstack sudo[94107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21
Sep 29 18:20:52 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:53 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21" returned: 0 in 0.591s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:53 devstack sudo[94113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21
Sep 29 18:20:53 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:53 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.b9164f4b-f123-45e2-8133-6f75ee36cc21" returned: 0 in 0.394s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-b9164f4b-f123-45e2-8133-6f75ee36cc21" released by "_delete_snapshot" :: held 2.039s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" released by "delete_snapshot" :: held 2.075s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:53 devstack cinder-volume[86821]: WARNING cinder.quota [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:20:53 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Created reservations ['9bd4168c-4797-4af2-88a2-dbc616b5ac25', '959fb672-5630-42cb-a151-30851e81b363', '1665e564-7be4-4704-935e-a11c6437360c', '56937aec-61c5-40f9-bc44-381e261169ca'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:20:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Delete snapshot completed successfully.
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f73e694a-e65d-4c39-8f1a-0fabc7ea23e4 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-b9164f4b-f123-45e2-8133-6f75ee36cc21-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:54 devstack sudo[94116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:20:54 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:54 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.363s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:20:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:20:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] Creating offline snapshot 83f60a6a-ec8e-4af9-8d77-385511399e86 of volume 6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:20:55 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d379081c-32d7-4402-a0b6-a600c851350f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:55 devstack sudo[94138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:20:55 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:55 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.422s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:20:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:56 devstack sudo[94144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86 1G
Sep 29 18:20:56 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:56 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86 1G" returned: 0 in 0.549s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:56 devstack sudo[94150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86
Sep 29 18:20:56 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:56 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86" returned: 0 in 0.385s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:56 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86 is being set with open permissions: ugo+rw
Sep 29 18:20:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:56 devstack sudo[94155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86
Sep 29 18:20:56 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:57 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86" returned: 0 in 0.243s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.759s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-075fb413-1d05-4955-b243-82b80dc38e01 tempest-SnapshotsActionsTest-808030137 None] Create snapshot completed successfully
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-83f60a6a-ec8e-4af9-8d77-385511399e86-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-83f60a6a-ec8e-4af9-8d77-385511399e86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-quobyte-83f60a6a-ec8e-4af9-8d77-385511399e86" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-83f60a6a-ec8e-4af9-8d77-385511399e86" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Deleting offline snapshot 83f60a6a-ec8e-4af9-8d77-385511399e86 of volume 6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] snapshot_file for this snap is: volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[82334659-797b-4241-b84b-79e8683a5966]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:57 devstack sudo[94158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86
Sep 29 18:20:57 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:58 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86" returned: 0 in 0.421s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b09d40-8d75-4cd2-9f57-3e36b7d30bdc]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:58 devstack sudo[94163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:20:58 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:58 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.553s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:58 devstack sudo[94169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86
Sep 29 18:20:58 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Flow 'volume_create_manager' (7869ae17-c734-48bd-88e3-78f7672b6a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfd7ea3-0ace-45a9-ac58-3d21f720fff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfd7ea3-0ace-45a9-ac58-3d21f720fff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1637432298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0bf3a6-f6ce-462b-9911-e9922d35c013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d418e691d982498e9d641ae019f09671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:59Z,use_quota=True,user_id='ab85765eee444c468a670664fc0cf276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f431d7d-ce0e-43ca-b17d-f649213ba363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f431d7d-ce0e-43ca-b17d-f649213ba363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ac2df6-36e5-4fda-94bd-cecb92669a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ac2df6-36e5-4fda-94bd-cecb92669a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0bf3a6-f6ce-462b-9911-e9922d35c013', 'volume_name': 'volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b27e96-c0e0-4d2d-8d4b-d03ffc0bb74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b27e96-c0e0-4d2d-8d4b-d03ffc0bb74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ec4fff-6260-4cc0-9c70-e52b53b8b530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:20:58 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Volume ea0bf3a6-f6ce-462b-9911-e9922d35c013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013', 'volume_size': 1}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1637432298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0bf3a6-f6ce-462b-9911-e9922d35c013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d418e691d982498e9d641ae019f09671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:59Z,use_quota=True,user_id='ab85765eee444c468a670664fc0cf276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Creating volume ea0bf3a6-f6ce-462b-9911-e9922d35c013 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:20:58 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:20:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:59 devstack sudo[94171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013 1073741824
Sep 29 18:20:59 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:59 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86" returned: 0 in 0.423s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:59 devstack sudo[94180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86
Sep 29 18:20:59 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:59 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013 1073741824" returned: 0 in 0.588s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:59 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root
Sep 29 18:20:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.83f60a6a-ec8e-4af9-8d77-385511399e86" returned: 0 in 0.324s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:20:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-83f60a6a-ec8e-4af9-8d77-385511399e86" released by "_delete_snapshot" :: held 1.852s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" released by "delete_snapshot" :: held 1.894s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:20:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:20:59 devstack sudo[94183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013
Sep 29 18:20:59 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:20:59 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Created reservations ['a9cdceb1-d2a2-43a9-b7ac-696e733b11b0', '3c816908-8481-4707-b823-3737899a4ed5', '2283eec1-bc70-4a67-85d5-44ed158ce535', '45c4b97b-cbaf-4868-9fc0-cda41ad39a60'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:20:59 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Delete snapshot completed successfully.
Sep 29 18:20:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8224caa6-8c31-42fc-8b0d-ad6427539e3c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-83f60a6a-ec8e-4af9-8d77-385511399e86-delete_snapshot" released by "delete_snapshot" :: held 2.142s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:00 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013" returned: 0 in 0.371s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ec4fff-6260-4cc0-9c70-e52b53b8b530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c5252a-63bd-4c29-8823-d800e4050ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:00 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Volume volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013 (ea0bf3a6-f6ce-462b-9911-e9922d35c013): created successfully
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c5252a-63bd-4c29-8823-d800e4050ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Flow 'volume_create_manager' (7869ae17-c734-48bd-88e3-78f7672b6a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:00 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-7b96591a-0ccc-4d8c-b5fe-3e0325b710bb tempest-VolumesTransfersTest-1700808539 None] Created volume successfully.
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] Creating offline snapshot 4de8488e-187e-4fa6-91f0-7ec0dba7f45f of volume 6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb1c0f7-abdd-4711-8144-b78e1dd50cec]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:00 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:21:00 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:00 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.379s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:21:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:00 devstack sudo[94192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f 1G
Sep 29 18:21:00 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:01 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f 1G" returned: 0 in 0.546s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:01 devstack sudo[94198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f
Sep 29 18:21:01 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:01 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f" returned: 0 in 0.362s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:01 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f is being set with open permissions: ugo+rw
Sep 29 18:21:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:01 devstack sudo[94204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f
Sep 29 18:21:01 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:01 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d53994f6-83af-447d-a889-2728a837a544 tempest-VolumesTransfersTest-1461843859 None] Transfer volume completed successfully.
Sep 29 18:21:01 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f" returned: 0 in 0.318s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.738s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:02 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d3f156ed-1c81-45ab-b950-48f1de1dda9b tempest-SnapshotsActionsTest-808030137 None] Create snapshot completed successfully
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-4de8488e-187e-4fa6-91f0-7ec0dba7f45f-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-4de8488e-187e-4fa6-91f0-7ec0dba7f45f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-quobyte-4de8488e-187e-4fa6-91f0-7ec0dba7f45f" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-4de8488e-187e-4fa6-91f0-7ec0dba7f45f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Deleting offline snapshot 4de8488e-187e-4fa6-91f0-7ec0dba7f45f of volume 6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] snapshot_file for this snap is: volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988da9d-4ab0-4e48-b257-5f191297931a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:02 devstack sudo[94208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f
Sep 29 18:21:02 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Acquiring lock "cinder-ea0bf3a6-f6ce-462b-9911-e9922d35c013-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Lock "cinder-ea0bf3a6-f6ce-462b-9911-e9922d35c013-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Acquiring lock "cinder-quobyte-ea0bf3a6-f6ce-462b-9911-e9922d35c013" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Lock "cinder-quobyte-ea0bf3a6-f6ce-462b-9911-e9922d35c013" acquired by "delete_volume" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[19efca55-0c1b-4511-9b77-a86498770da9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:03 devstack sudo[94210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013
Sep 29 18:21:03 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:03 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f" returned: 0 in 0.628s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d052ef38-3d32-4f9d-84b0-f9297a75765c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:03 devstack sudo[94215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:21:03 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:03 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013" returned: 0 in 0.509s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:03 devstack sudo[94221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013
Sep 29 18:21:03 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:03 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.469s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:03 devstack sudo[94226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f
Sep 29 18:21:03 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:03 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ea0bf3a6-f6ce-462b-9911-e9922d35c013" returned: 0 in 0.315s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Lock "cinder-quobyte-ea0bf3a6-f6ce-462b-9911-e9922d35c013" released by "delete_volume" :: held 0.914s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Created reservations ['ff2450e6-7749-4d5f-a377-922be5f3edda', '4c5902ef-cfd7-473c-ac33-da3913f642b5', '330dd217-eac9-48be-945b-dafb9df677a9', 'ca3251e7-c535-41c6-8414-2e737883bb37'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:04 devstack sudo[94233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:21:04 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:04 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f" returned: 0 in 0.530s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:04 devstack sudo[94235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f
Sep 29 18:21:04 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:04 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.442s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:21:04 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Deleted volume successfully.
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-118cd553-731a-44fb-90a2-bd3ed8c839a5 tempest-VolumesTransfersTest-258192291 None] Lock "cinder-ea0bf3a6-f6ce-462b-9911-e9922d35c013-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:04 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.4de8488e-187e-4fa6-91f0-7ec0dba7f45f" returned: 0 in 0.487s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-4de8488e-187e-4fa6-91f0-7ec0dba7f45f" released by "_delete_snapshot" :: held 2.315s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" released by "delete_snapshot" :: held 2.356s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:04 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Created reservations ['81b40974-0b09-4f20-b42a-8e7b6e750da9', 'be9d1a4e-c223-4c13-b5d6-fa1e361e0efb', 'f114679e-0c66-4612-8365-0f6ced7d711a', 'af7042e0-6635-412d-bb4a-d145431fde6a'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Flow 'volume_create_manager' (d3ec09e4-dff4-4cf9-a6b2-8e0bde71ed9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70529b46-1926-4810-a06c-70fcf4f3c744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70529b46-1926-4810-a06c-70fcf4f3c744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1869603563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975de277-a755-49c0-8a52-d93bf74e0973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d418e691d982498e9d641ae019f09671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:05Z,use_quota=True,user_id='ab85765eee444c468a670664fc0cf276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d9ec77-aae3-4cfa-a9d7-9d8faea1b7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d9ec77-aae3-4cfa-a9d7-9d8faea1b7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538ba554-9d09-4d6c-912a-d56eb55eb62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538ba554-9d09-4d6c-912a-d56eb55eb62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '975de277-a755-49c0-8a52-d93bf74e0973', 'volume_name': 'volume-975de277-a755-49c0-8a52-d93bf74e0973', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8cc67f-070b-4dfc-b879-d48be18c2bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8cc67f-070b-4dfc-b879-d48be18c2bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f04dc2-dc83-4d98-be5f-37619611defd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:05 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Volume 975de277-a755-49c0-8a52-d93bf74e0973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-975de277-a755-49c0-8a52-d93bf74e0973', 'volume_size': 1}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1869603563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975de277-a755-49c0-8a52-d93bf74e0973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d418e691d982498e9d641ae019f09671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:05Z,use_quota=True,user_id='ab85765eee444c468a670664fc0cf276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Creating volume 975de277-a755-49c0-8a52-d93bf74e0973 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:21:05 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Delete snapshot completed successfully.
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fe8caebf-9a11-4436-8948-4f5ee1553a15 tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-4de8488e-187e-4fa6-91f0-7ec0dba7f45f-delete_snapshot" released by "delete_snapshot" :: held 2.668s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:05 devstack sudo[94239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973 1073741824
Sep 29 18:21:05 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:05 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973 1073741824" returned: 0 in 0.587s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:05 devstack sudo[94245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973
Sep 29 18:21:05 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:06 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973" returned: 0 in 0.459s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f04dc2-dc83-4d98-be5f-37619611defd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-975de277-a755-49c0-8a52-d93bf74e0973', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7aa550-b08a-4d90-894f-800dd32e8321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] Creating offline snapshot d0410435-0d78-41c5-94e5-24b597a439bc of volume 6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:21:06 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Volume volume-975de277-a755-49c0-8a52-d93bf74e0973 (975de277-a755-49c0-8a52-d93bf74e0973): created successfully
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7aa550-b08a-4d90-894f-800dd32e8321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Flow 'volume_create_manager' (d3ec09e4-dff4-4cf9-a6b2-8e0bde71ed9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:06 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a4b1ed34-f977-4137-8ad5-d3c26290829d tempest-VolumesTransfersTest-1700808539 None] Created volume successfully.
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5636b78a-ab92-4da9-ac68-406f4dcc4f29]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:06 devstack sudo[94250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:21:06 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:06 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.423s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:21:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:06 devstack sudo[94259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc 1G
Sep 29 18:21:06 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:07 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc 1G" returned: 0 in 0.653s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:07 devstack sudo[94287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc
Sep 29 18:21:07 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Acquiring lock "cinder-975de277-a755-49c0-8a52-d93bf74e0973-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Lock "cinder-975de277-a755-49c0-8a52-d93bf74e0973-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Acquiring lock "cinder-quobyte-975de277-a755-49c0-8a52-d93bf74e0973" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Lock "cinder-quobyte-975de277-a755-49c0-8a52-d93bf74e0973" acquired by "delete_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:07 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7620ad54-09ad-4a5c-b1dd-60221a07d697]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:07 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc" returned: 0 in 0.487s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:07 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc is being set with open permissions: ugo+rw
Sep 29 18:21:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:08 devstack sudo[94296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc
Sep 29 18:21:08 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:08 devstack sudo[94295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973
Sep 29 18:21:08 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:08 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc" returned: 0 in 0.428s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:08 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-eff1b8a3-6199-425e-8af7-5ee986917fbc tempest-SnapshotsActionsTest-808030137 None] Create snapshot completed successfully
Sep 29 18:21:08 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973" returned: 0 in 0.644s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:08 devstack sudo[94315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973
Sep 29 18:21:08 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:08 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-975de277-a755-49c0-8a52-d93bf74e0973" returned: 0 in 0.326s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:08 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Lock "cinder-quobyte-975de277-a755-49c0-8a52-d93bf74e0973" released by "delete_volume" :: held 1.038s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Created reservations ['4e797d05-10d4-45d5-aab7-afd91fe6f811', '19385151-370e-4bef-9140-d3ea41a688ef', 'b87ba645-f579-4e3e-be8e-7f603b47ba3d', '91caa546-6f85-4454-8d1d-e63bb2162454'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:09 devstack sudo[94319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:21:09 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:09 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.294s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:21:09 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Deleted volume successfully.
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4fb83a42-29a3-430a-8d2f-54177b22dea5 tempest-VolumesTransfersTest-258192291 None] Lock "cinder-975de277-a755-49c0-8a52-d93bf74e0973-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-d0410435-0d78-41c5-94e5-24b597a439bc-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-d0410435-0d78-41c5-94e5-24b597a439bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Acquiring lock "cinder-quobyte-d0410435-0d78-41c5-94e5-24b597a439bc" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-d0410435-0d78-41c5-94e5-24b597a439bc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Deleting offline snapshot d0410435-0d78-41c5-94e5-24b597a439bc of volume 6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] snapshot_file for this snap is: volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[963e7afc-17e9-4b5e-8231-817c82b3edf6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:09 devstack sudo[94323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc
Sep 29 18:21:09 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:10 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc" returned: 0 in 0.440s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:21:10 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[376bfef0-c365-4234-9f67-ba25e743e573]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:10 devstack sudo[94328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:21:10 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:10 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.524s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:21:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:10 devstack sudo[94333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc
Sep 29 18:21:10 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:11 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc" returned: 0 in 0.624s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:11 devstack sudo[94339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc
Sep 29 18:21:11 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:11 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.d0410435-0d78-41c5-94e5-24b597a439bc" returned: 0 in 0.408s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-d0410435-0d78-41c5-94e5-24b597a439bc" released by "_delete_snapshot" :: held 2.160s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" released by "delete_snapshot" :: held 2.198s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:11 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=109,cinder:UPDATE=117,cinder:INSERT=29,cinder:DELETE=10 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:21:11 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=96,cinder:UPDATE=108,cinder:DELETE=8,cinder:INSERT=25 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:21:12 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Created reservations ['1dc906d5-70e4-4282-98c6-3ce0038d348a', '7400ea93-f88a-430c-ac3a-57fb16eee1c0', '19780060-c58c-458a-b74f-14a1b90d5740', '920e42b0-1ec1-4ed9-a21c-5a56b859fc24'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:21:12 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Delete snapshot completed successfully.
Sep 29 18:21:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38787a8a-5abe-4a56-96be-5a4fa9de502c tempest-SnapshotsActionsTest-1779667824 None] Lock "cinder-d0410435-0d78-41c5-94e5-24b597a439bc-delete_snapshot" released by "delete_snapshot" :: held 2.394s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "cinder-bf5856d9-82f5-4af9-b563-3f30d5ebf079-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Lock "cinder-bf5856d9-82f5-4af9-b563-3f30d5ebf079-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "cinder-quobyte-bf5856d9-82f5-4af9-b563-3f30d5ebf079" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Lock "cinder-quobyte-bf5856d9-82f5-4af9-b563-3f30d5ebf079" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Deleting offline snapshot bf5856d9-82f5-4af9-b563-3f30d5ebf079 of volume 6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] snapshot_file for this snap is: volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e3f248-95a0-4895-856b-a0de9a1fe7ba]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:13 devstack sudo[94343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:21:13 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:13 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.410s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f543a36-a00d-48e7-9604-403ce0682c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:21:14 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc293a6-3bd2-4167-b245-cb33e230a51b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:14 devstack sudo[94349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c
Sep 29 18:21:14 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:14 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c" returned: 0 in 0.519s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:14 devstack sudo[94354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:21:14 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:15 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.575s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:15 devstack sudo[94359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079
Sep 29 18:21:15 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:15 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c.bf5856d9-82f5-4af9-b563-3f30d5ebf079" returned: 0 in 0.420s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Lock "cinder-quobyte-bf5856d9-82f5-4af9-b563-3f30d5ebf079" released by "_delete_snapshot" :: held 2.137s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" released by "delete_snapshot" :: held 2.171s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:15 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Created reservations ['03bb77d0-bbe9-4c0f-8339-0036963db606', 'ddfed534-c86f-430c-ac9c-75bd0d8438b6', 'e8631a07-c0cb-4238-b011-eecb84866210', '840004fd-c6e6-4350-8a61-e3ec4e3132b0'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:21:15 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Delete snapshot completed successfully.
Sep 29 18:21:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff1f338f-e2ed-4510-aae8-13462d96e898 tempest-SnapshotsActionsTest-808030137 None] Lock "cinder-bf5856d9-82f5-4af9-b563-3f30d5ebf079-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:16 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-2968306e-8bce-45ba-a4a9-e6438ba29ddf req-28316155-6e3c-494e-bbff-55c84600153f tempest-AttachVolumeNegativeTest-103688396 None] Terminate volume connection completed successfully.
Sep 29 18:21:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-2968306e-8bce-45ba-a4a9-e6438ba29ddf req-28316155-6e3c-494e-bbff-55c84600153f tempest-AttachVolumeNegativeTest-103688396 None] Deleting attachment e5a68245-177f-4cdd-ae14-5c2309215e56. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:21:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "cinder-6f543a36-a00d-48e7-9604-403ce0682c9c-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Lock "cinder-6f543a36-a00d-48e7-9604-403ce0682c9c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" acquired by "delete_volume" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:17 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7853f884-c721-4229-bb7c-1666efd3c59c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:17 devstack sudo[94370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c
Sep 29 18:21:17 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:17 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c" returned: 0 in 0.758s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:17 devstack sudo[94397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c
Sep 29 18:21:17 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:18 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6f543a36-a00d-48e7-9604-403ce0682c9c" returned: 0 in 0.363s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Lock "cinder-quobyte-6f543a36-a00d-48e7-9604-403ce0682c9c" released by "delete_volume" :: held 1.216s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Created reservations ['ed33801c-b91d-4e2d-9018-d427ab08ee49', '00b975cc-a037-4576-8165-801dc835cf74', '68a94803-fcc7-4caf-b47c-de4bdfea92a9', '76319b19-3e6c-45de-8ef6-a1f3e65f6198'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:18 devstack sudo[94415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:21:18 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:18 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.370s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:21:18 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Deleted volume successfully.
Sep 29 18:21:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23ca5996-ff2a-41f8-9b7d-d1599eed4699 tempest-SnapshotsActionsTest-808030137 None] Lock "cinder-6f543a36-a00d-48e7-9604-403ce0682c9c-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Flow 'volume_create_manager' (e41fe57d-97a3-417f-863f-9e39bf8e0143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa913a32-3bd8-499c-865b-e3f059521966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa913a32-3bd8-499c-865b-e3f059521966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-454731833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621a6b7a-8d94-49d8-9f12-40eb40654221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c46c91480194cb1954243f8717f8362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:21Z,use_quota=True,user_id='dd7f57bb27f24813b3a43920b1aeecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c1355c-c6ab-4825-95d8-c42385ac6ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c1355c-c6ab-4825-95d8-c42385ac6ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e233b4b-ab07-41fc-a44e-0e1c1b69faf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e233b4b-ab07-41fc-a44e-0e1c1b69faf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621a6b7a-8d94-49d8-9f12-40eb40654221', 'volume_name': 'volume-621a6b7a-8d94-49d8-9f12-40eb40654221', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5f3017-cc44-4e58-b37b-3ded5b8911e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5f3017-cc44-4e58-b37b-3ded5b8911e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b81a75-ff90-4a18-a5c2-c038fd3379ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:21 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Volume 621a6b7a-8d94-49d8-9f12-40eb40654221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621a6b7a-8d94-49d8-9f12-40eb40654221', 'volume_size': 1}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-454731833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621a6b7a-8d94-49d8-9f12-40eb40654221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c46c91480194cb1954243f8717f8362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:21Z,use_quota=True,user_id='dd7f57bb27f24813b3a43920b1aeecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Creating volume 621a6b7a-8d94-49d8-9f12-40eb40654221 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:21:21 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:21:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:21 devstack sudo[94446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 1073741824
Sep 29 18:21:21 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:22 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 1073741824" returned: 0 in 0.722s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:22 devstack sudo[94454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221
Sep 29 18:21:22 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:22 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221" returned: 0 in 0.381s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:21:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b81a75-ff90-4a18-a5c2-c038fd3379ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621a6b7a-8d94-49d8-9f12-40eb40654221', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c17c817-09c0-432f-a80b-2db50162d483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:22 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Volume volume-621a6b7a-8d94-49d8-9f12-40eb40654221 (621a6b7a-8d94-49d8-9f12-40eb40654221): created successfully
Sep 29 18:21:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c17c817-09c0-432f-a80b-2db50162d483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Flow 'volume_create_manager' (e41fe57d-97a3-417f-863f-9e39bf8e0143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:22 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6f40dcc3-7d90-48b2-a02c-bf17470446df tempest-VolumesCloneTest-1308771808 None] Created volume successfully.
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Flow 'volume_create_manager' (1a4e96bf-1728-401d-95db-358762c3aca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ac0a88-7372-4e62-ac9a-73dba34aeaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ac0a88-7372-4e62-ac9a-73dba34aeaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-35510255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f5096c-638f-4ca5-905f-b6e5602a3aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c46c91480194cb1954243f8717f8362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=621a6b7a-8d94-49d8-9f12-40eb40654221,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:24Z,use_quota=True,user_id='dd7f57bb27f24813b3a43920b1aeecd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bc2202-1464-4d45-b1d6-7aefd82260e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bc2202-1464-4d45-b1d6-7aefd82260e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d777485-29fd-4eb0-9e13-41b174c904c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d777485-29fd-4eb0-9e13-41b174c904c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '99f5096c-638f-4ca5-905f-b6e5602a3aa1', 'volume_name': 'volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1', 'volume_size': 2, 'source_volid': '621a6b7a-8d94-49d8-9f12-40eb40654221', 'source_volstatus': 'available'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1455b-ddab-4d15-acba-f0ef51c0b588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1455b-ddab-4d15-acba-f0ef51c0b588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f40f34d-9b03-461b-bb89-35ae45d485ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:24 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Volume 99f5096c-638f-4ca5-905f-b6e5602a3aa1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1', 'volume_size': 2, 'source_volid': '621a6b7a-8d94-49d8-9f12-40eb40654221', 'source_volstatus': 'available'}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:24 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Cloning volume 621a6b7a-8d94-49d8-9f12-40eb40654221 to volume 99f5096c-638f-4ca5-905f-b6e5602a3aa1
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Creating offline snapshot 4aec9ff8-ede4-4077-a837-32ecc5df523e of volume 621a6b7a-8d94-49d8-9f12-40eb40654221 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb15eb-d368-4d27-8fa6-03898fe08d7d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:24 devstack sudo[94472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221
Sep 29 18:21:24 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:25 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221" returned: 0 in 0.496s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:25 devstack sudo[94477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e 1G
Sep 29 18:21:25 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:25 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e 1G" returned: 0 in 0.621s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621a6b7a-8d94-49d8-9f12-40eb40654221 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:25 devstack sudo[94483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621a6b7a-8d94-49d8-9f12-40eb40654221 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e
Sep 29 18:21:25 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:26 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621a6b7a-8d94-49d8-9f12-40eb40654221 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e" returned: 0 in 0.428s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:26 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e is being set with open permissions: ugo+rw
Sep 29 18:21:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:26 devstack sudo[94489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e
Sep 29 18:21:26 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:26 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e" returned: 0 in 0.352s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:26 devstack sudo[94493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.info
Sep 29 18:21:26 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.info" returned: 0 in 0.476s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:27 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.info is being set with open permissions: ugo+rw
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:27 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:27 devstack sudo[94499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.info
Sep 29 18:21:27 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:27 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.info" returned: 0 in 0.607s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Acquiring lock "cinder-quobyte-99f5096c-638f-4ca5-905f-b6e5602a3aa1" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Lock "cinder-quobyte-99f5096c-638f-4ca5-905f-b6e5602a3aa1" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] snapshot: 4aec9ff8-ede4-4077-a837-32ecc5df523e, volume: 99f5096c-638f-4ca5-905f-b6e5602a3aa1,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d064a859-0ea5-4c01-ad7c-08a3ed998d73]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:28 devstack sudo[94543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e
Sep 29 18:21:28 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:28 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e" returned: 0 in 0.868s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-621a6b7a-8d94-49d8-9f12-40eb40654221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:21:28 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ab13f7-e4f7-4c05-b0af-f1182392e57f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:28 devstack sudo[94570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221
Sep 29 18:21:28 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:29 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221" returned: 0 in 0.422s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:21:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:21:29 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1 not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:21:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:29 devstack sudo[94597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1
Sep 29 18:21:29 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:36 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:INSERT=6,cinder:UPDATE=22,cinder:SELECT=18,cinder:DELETE=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:21:36 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=24,cinder:INSERT=9,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:21:41 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1" returned: 0 in 12.181s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:41 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221, size 1024.00 MB, duration 12.18 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1 {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:21:41 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Converted 1024.00 MB image at 84.06 MB/s
Sep 29 18:21:41 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1 is being set with open permissions: ugo+rw
Sep 29 18:21:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:41 devstack sudo[94704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1
Sep 29 18:21:41 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:41 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1" returned: 0 in 0.503s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Lock "cinder-quobyte-99f5096c-638f-4ca5-905f-b6e5602a3aa1" released by "_copy_volume_from_snapshot" :: held 14.139s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Acquiring lock "cinder-quobyte-4aec9ff8-ede4-4077-a837-32ecc5df523e" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Lock "cinder-quobyte-4aec9ff8-ede4-4077-a837-32ecc5df523e" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Deleting offline snapshot 4aec9ff8-ede4-4077-a837-32ecc5df523e of volume 621a6b7a-8d94-49d8-9f12-40eb40654221 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:21:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] snapshot_file for this snap is: volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:21:42 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[53176ca3-095c-4f1f-be88-282262774421]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:42 devstack sudo[94725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e
Sep 29 18:21:42 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:42 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e" returned: 0 in 0.713s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-621a6b7a-8d94-49d8-9f12-40eb40654221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:21:42 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5934a579-6366-4ae5-a829-0bc23c098dfe]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:43 devstack sudo[94731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221
Sep 29 18:21:43 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:44 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221" returned: 0 in 1.452s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:44 devstack sudo[94740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e
Sep 29 18:21:44 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:44 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e" returned: 0 in 0.540s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:44 devstack sudo[94765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e
Sep 29 18:21:44 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:45 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221.4aec9ff8-ede4-4077-a837-32ecc5df523e" returned: 0 in 0.372s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Lock "cinder-quobyte-4aec9ff8-ede4-4077-a837-32ecc5df523e" released by "_delete_snapshot" :: held 3.261s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.769s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f40f34d-9b03-461b-bb89-35ae45d485ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1', 'volume_size': 2, 'source_volid': '621a6b7a-8d94-49d8-9f12-40eb40654221', 'source_volstatus': 'available'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6924127-fccd-4b9a-b1c1-3a9e93123bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:45 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Volume volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1 (99f5096c-638f-4ca5-905f-b6e5602a3aa1): created successfully
Sep 29 18:21:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6924127-fccd-4b9a-b1c1-3a9e93123bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Flow 'volume_create_manager' (1a4e96bf-1728-401d-95db-358762c3aca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e7fcf8ac-be36-4d33-a119-f61c908df24b tempest-VolumesCloneTest-1308771808 None] Created volume successfully.
Sep 29 18:21:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Acquiring lock "cinder-99f5096c-638f-4ca5-905f-b6e5602a3aa1-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Lock "cinder-99f5096c-638f-4ca5-905f-b6e5602a3aa1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Acquiring lock "cinder-quobyte-99f5096c-638f-4ca5-905f-b6e5602a3aa1" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Lock "cinder-quobyte-99f5096c-638f-4ca5-905f-b6e5602a3aa1" acquired by "delete_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc71434c-05ff-4b14-b928-59d4d2231304]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:47 devstack sudo[94770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1
Sep 29 18:21:47 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:47 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1" returned: 0 in 0.457s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:47 devstack sudo[94775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1
Sep 29 18:21:47 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:47 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99f5096c-638f-4ca5-905f-b6e5602a3aa1" returned: 0 in 0.273s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Lock "cinder-quobyte-99f5096c-638f-4ca5-905f-b6e5602a3aa1" released by "delete_volume" :: held 0.797s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Created reservations ['992c2347-b243-420c-94c7-a53e51101f1a', 'd094b59e-c898-495b-9c31-7341f61c9084', 'c92208bc-b7ff-49f1-984d-f1153326922b', '48efc649-bfcb-4934-96a9-efa9f5a5744a'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:48 devstack sudo[94778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:21:48 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:48 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.338s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:48 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:21:48 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Deleted volume successfully.
Sep 29 18:21:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Acquiring lock "cinder-621a6b7a-8d94-49d8-9f12-40eb40654221-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Lock "cinder-621a6b7a-8d94-49d8-9f12-40eb40654221-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-296d4d03-5b05-42b5-bc23-3647b2027ebb tempest-VolumesCloneTest-1308771808 None] Lock "cinder-99f5096c-638f-4ca5-905f-b6e5602a3aa1-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Acquiring lock "cinder-quobyte-621a6b7a-8d94-49d8-9f12-40eb40654221" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:21:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Lock "cinder-quobyte-621a6b7a-8d94-49d8-9f12-40eb40654221" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:21:48 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5e015d-d074-40b0-b733-0dc23745ada2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:21:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:48 devstack sudo[94781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221
Sep 29 18:21:48 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:48 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221" returned: 0 in 0.433s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:49 devstack sudo[94787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221
Sep 29 18:21:49 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:49 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-621a6b7a-8d94-49d8-9f12-40eb40654221" returned: 0 in 0.268s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Lock "cinder-quobyte-621a6b7a-8d94-49d8-9f12-40eb40654221" released by "delete_volume" :: held 0.782s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Created reservations ['164d4843-46bd-4fa4-8431-d61028548253', 'e1687366-7aa2-47c8-ba90-56cd350c4b62', '7441501b-0372-4bff-8c97-150437e9eb67', '0ab76064-a995-4a74-8e0f-e7f2fd5e753a'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:49 devstack sudo[94790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:21:49 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:49 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.319s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:21:49 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Deleted volume successfully.
Sep 29 18:21:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-998992cb-e75e-470a-9bb9-5acc44dceb89 tempest-VolumesCloneTest-1308771808 None] Lock "cinder-621a6b7a-8d94-49d8-9f12-40eb40654221-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:21:53 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:21:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Flow 'volume_create_manager' (a185c9ba-9008-4b0b-ab78-16be6e0cc99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5f0e8e-db12-4809-bf16-9e00fc4e29ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5f0e8e-db12-4809-bf16-9e00fc4e29ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-777728626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d57835-9150-4071-be2d-5f841732ea95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5fe79a4d404ea29e7aaac7685dc50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:54Z,use_quota=True,user_id='064b23db58a344c587e0498e45056857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df48cdb-7533-475f-b82b-d01e58a3fae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df48cdb-7533-475f-b82b-d01e58a3fae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd59ac0-44e8-46d5-930d-51dee2616b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd59ac0-44e8-46d5-930d-51dee2616b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d57835-9150-4071-be2d-5f841732ea95', 'volume_name': 'volume-a7d57835-9150-4071-be2d-5f841732ea95', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450a2476-b8b5-44ac-9910-35952bff0dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450a2476-b8b5-44ac-9910-35952bff0dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccb1ec5-a529-4469-acfc-d4cb926b7d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:54 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Volume a7d57835-9150-4071-be2d-5f841732ea95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d57835-9150-4071-be2d-5f841732ea95', 'volume_size': 1}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-777728626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d57835-9150-4071-be2d-5f841732ea95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5fe79a4d404ea29e7aaac7685dc50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:54Z,use_quota=True,user_id='064b23db58a344c587e0498e45056857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Creating volume a7d57835-9150-4071-be2d-5f841732ea95 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:21:54 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:54 devstack sudo[94800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95 1073741824
Sep 29 18:21:54 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:54 devstack sudo[94805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:21:54 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:54 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95 1073741824" returned: 0 in 0.687s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:54 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.436s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:21:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:21:54 devstack sudo[94809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95
Sep 29 18:21:54 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:55 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95" returned: 0 in 0.402s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccb1ec5-a529-4469-acfc-d4cb926b7d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d57835-9150-4071-be2d-5f841732ea95', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f9a201-e362-4122-819b-3607164b18a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:55 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Volume volume-a7d57835-9150-4071-be2d-5f841732ea95 (a7d57835-9150-4071-be2d-5f841732ea95): created successfully
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f9a201-e362-4122-819b-3607164b18a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Flow 'volume_create_manager' (a185c9ba-9008-4b0b-ab78-16be6e0cc99e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:55 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-042dbda9-3ed5-491f-920b-d56c41f28089 tempest-AttachVolumeTestJSON-623007192 None] Created volume successfully.
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (0741c0b8-be93-4e71-8ed2-241c9735050a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de8742d-ce93-49ac-89cd-b75147c5c7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de8742d-ce93-49ac-89cd-b75147c5c7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-338559040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49454d7-db09-4bd3-9ea5-ba0de9946533,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:56Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96fc77b-c503-4748-ae41-541a7275d1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96fc77b-c503-4748-ae41-541a7275d1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043087d0-b5fa-4c9a-acd0-9839cc0af6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043087d0-b5fa-4c9a-acd0-9839cc0af6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e49454d7-db09-4bd3-9ea5-ba0de9946533', 'volume_name': 'volume-e49454d7-db09-4bd3-9ea5-ba0de9946533', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf39ffe-ab07-41b6-9353-4165f3f48ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf39ffe-ab07-41b6-9353-4165f3f48ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91381d6b-ba83-490c-a0a5-8c09cde3d618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:55 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Volume e49454d7-db09-4bd3-9ea5-ba0de9946533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e49454d7-db09-4bd3-9ea5-ba0de9946533', 'volume_size': 1}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-338559040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49454d7-db09-4bd3-9ea5-ba0de9946533,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:56Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Creating volume e49454d7-db09-4bd3-9ea5-ba0de9946533 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:21:55 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:21:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:55 devstack sudo[94812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533 1073741824
Sep 29 18:21:55 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:56 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533 1073741824" returned: 0 in 0.673s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:56 devstack sudo[94842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533
Sep 29 18:21:56 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:56 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533" returned: 0 in 0.345s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:21:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91381d6b-ba83-490c-a0a5-8c09cde3d618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e49454d7-db09-4bd3-9ea5-ba0de9946533', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f1d3d2-32b3-4c73-b04e-59f3c2aa5dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:57 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Volume volume-e49454d7-db09-4bd3-9ea5-ba0de9946533 (e49454d7-db09-4bd3-9ea5-ba0de9946533): created successfully
Sep 29 18:21:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f1d3d2-32b3-4c73-b04e-59f3c2aa5dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (0741c0b8-be93-4e71-8ed2-241c9735050a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6944434c-5912-48d0-b079-0707c996f4cf tempest-VolumesGetTest-1169938720 None] Created volume successfully.
Sep 29 18:21:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-b6bae22b-f0ee-4e7d-b50b-3418b2fd6128 req-2a8fc403-b3ea-425f-9623-9c8e87ed5bb3 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-b6bae22b-f0ee-4e7d-b50b-3418b2fd6128 req-2a8fc403-b3ea-425f-9623-9c8e87ed5bb3 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-b6bae22b-f0ee-4e7d-b50b-3418b2fd6128 req-2a8fc403-b3ea-425f-9623-9c8e87ed5bb3 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-b6bae22b-f0ee-4e7d-b50b-3418b2fd6128 req-2a8fc403-b3ea-425f-9623-9c8e87ed5bb3 tempest-AttachVolumeTestJSON-623007192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-a7d57835-9150-4071-be2d-5f841732ea95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4af48b79-b326-4bd6-8f1a-7279a5afa166', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:21:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-b6bae22b-f0ee-4e7d-b50b-3418b2fd6128 req-2a8fc403-b3ea-425f-9623-9c8e87ed5bb3 tempest-AttachVolumeTestJSON-623007192 None] attachment_update completed successfully.
Sep 29 18:21:58 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (3bc15a51-dc8a-497b-9ddf-4b563e698ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c101513-c515-46d2-bb4b-d12916160625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c101513-c515-46d2-bb4b-d12916160625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:21:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-11289731',display_name='tempest-VolumesGetTest-Volume-733949029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3f94c2-126f-4253-89d6-58327d6563f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:59Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eef64bc-1975-48c2-8ff7-6a62b1da332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eef64bc-1975-48c2-8ff7-6a62b1da332a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec935f9-b1a0-4c25-b038-6470d48f49f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec935f9-b1a0-4c25-b038-6470d48f49f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3f94c2-126f-4253-89d6-58327d6563f1', 'volume_name': 'volume-5b3f94c2-126f-4253-89d6-58327d6563f1', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a543e52-6ab7-4285-b0bc-d28c58fcc025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a543e52-6ab7-4285-b0bc-d28c58fcc025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6941cd-003b-4e49-8893-ede8fcccf0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:21:59 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Volume 5b3f94c2-126f-4253-89d6-58327d6563f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3f94c2-126f-4253-89d6-58327d6563f1', 'volume_size': 1}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:21:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-11289731',display_name='tempest-VolumesGetTest-Volume-733949029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3f94c2-126f-4253-89d6-58327d6563f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:59Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Creating volume 5b3f94c2-126f-4253-89d6-58327d6563f1 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:21:59 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:59 devstack sudo[95272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1 1073741824
Sep 29 18:21:59 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:21:59 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1 1073741824" returned: 0 in 0.620s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:21:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:21:59 devstack sudo[95284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1
Sep 29 18:21:59 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:00 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1" returned: 0 in 0.310s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:22:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6941cd-003b-4e49-8893-ede8fcccf0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3f94c2-126f-4253-89d6-58327d6563f1', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2add5e1-9e0a-41a7-98aa-4dfa73b55f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:00 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Volume volume-5b3f94c2-126f-4253-89d6-58327d6563f1 (5b3f94c2-126f-4253-89d6-58327d6563f1): created successfully
Sep 29 18:22:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2add5e1-9e0a-41a7-98aa-4dfa73b55f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (3bc15a51-dc8a-497b-9ddf-4b563e698ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:00 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-124e0639-ac4f-4d31-90a1-6430f6053ca1 tempest-VolumesGetTest-1169938720 None] Created volume successfully.
Sep 29 18:22:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-5b3f94c2-126f-4253-89d6-58327d6563f1-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Lock "cinder-5b3f94c2-126f-4253-89d6-58327d6563f1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-quobyte-5b3f94c2-126f-4253-89d6-58327d6563f1" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-5b3f94c2-126f-4253-89d6-58327d6563f1" acquired by "delete_volume" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:01 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d7d7db-0b15-4a7b-ab47-0957c5da92d7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:01 devstack sudo[95292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1
Sep 29 18:22:01 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:01 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1" returned: 0 in 0.498s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:01 devstack sudo[95298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1
Sep 29 18:22:01 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:02 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5b3f94c2-126f-4253-89d6-58327d6563f1" returned: 0 in 0.271s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-5b3f94c2-126f-4253-89d6-58327d6563f1" released by "delete_volume" :: held 0.834s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Created reservations ['14018acf-5407-48a7-909c-d90b4a0035fa', '1e999525-3645-4688-a980-180800fa5226', '8f0e7874-1955-4ade-a1a9-ca342e0f1400', 'ff93017c-64ff-4d52-8b52-56d9554d27a5'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:02 devstack sudo[95302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:22:02 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-e49454d7-db09-4bd3-9ea5-ba0de9946533-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Lock "cinder-e49454d7-db09-4bd3-9ea5-ba0de9946533-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-quobyte-e49454d7-db09-4bd3-9ea5-ba0de9946533" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-e49454d7-db09-4bd3-9ea5-ba0de9946533" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:02 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.570s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:22:02 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Deleted volume successfully.
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[687b20b7-b1e9-4a0a-a607-9e52a0e7a9b6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78864526-b931-435d-9642-e1e291f14e3d tempest-VolumesGetTest-1169938720 None] Lock "cinder-5b3f94c2-126f-4253-89d6-58327d6563f1-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:03 devstack sudo[95370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533
Sep 29 18:22:03 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Flow 'volume_create_manager' (399f6a5e-39c2-416d-971d-ccde6589ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b98b837-47bc-48d1-b7df-46fdd0440d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:03 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b98b837-47bc-48d1-b7df-46fdd0440d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2040210136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeaf5208-abef-464c-963c-7c5cba3948da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8caeb248bf244589ea675f291449643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:03Z,use_quota=True,user_id='bbc6ed2238784185b5558b9fcfb23afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e04d5c-909d-4090-82fa-b13c74368485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e04d5c-909d-4090-82fa-b13c74368485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fca2037-526a-444f-822d-9a96282d2b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fca2037-526a-444f-822d-9a96282d2b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeaf5208-abef-464c-963c-7c5cba3948da', 'volume_name': 'volume-aeaf5208-abef-464c-963c-7c5cba3948da', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b898de-fc07-4e45-a675-381964a54a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b898de-fc07-4e45-a675-381964a54a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f824940-14e6-4b4d-98cd-bb0ae4ffb4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:03 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Volume aeaf5208-abef-464c-963c-7c5cba3948da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeaf5208-abef-464c-963c-7c5cba3948da', 'volume_size': 1}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2040210136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeaf5208-abef-464c-963c-7c5cba3948da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8caeb248bf244589ea675f291449643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:03Z,use_quota=True,user_id='bbc6ed2238784185b5558b9fcfb23afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Creating volume aeaf5208-abef-464c-963c-7c5cba3948da {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:22:03 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533" returned: 0 in 0.666s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:03 devstack sudo[95454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da 1073741824
Sep 29 18:22:03 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:03 devstack sudo[95455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533
Sep 29 18:22:03 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:03 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e49454d7-db09-4bd3-9ea5-ba0de9946533" returned: 0 in 0.392s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-e49454d7-db09-4bd3-9ea5-ba0de9946533" released by "delete_volume" :: held 1.143s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Created reservations ['786e59f9-b3ce-411c-b05a-86a7204fdec0', 'fa40bf9c-54f7-4c1d-b797-67bf376875f8', 'e8bf429b-4b0f-4586-adb4-cb3de1569d15', '0d38e634-1e13-481b-8e72-5cfc36b582c0'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:04 devstack sudo[95482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:22:04 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:04 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da 1073741824" returned: 0 in 0.926s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:04 devstack sudo[95816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da
Sep 29 18:22:04 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:04 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.530s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:22:04 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Deleted volume successfully.
Sep 29 18:22:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f2a962c8-ceb9-4e51-92c2-fc95add9d2c4 tempest-VolumesGetTest-1169938720 None] Lock "cinder-e49454d7-db09-4bd3-9ea5-ba0de9946533-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:05 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da" returned: 0 in 0.478s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:22:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f824940-14e6-4b4d-98cd-bb0ae4ffb4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeaf5208-abef-464c-963c-7c5cba3948da', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a317e96-50d0-4901-8d52-6d8befb2e4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:05 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Volume volume-aeaf5208-abef-464c-963c-7c5cba3948da (aeaf5208-abef-464c-963c-7c5cba3948da): created successfully
Sep 29 18:22:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a317e96-50d0-4901-8d52-6d8befb2e4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Flow 'volume_create_manager' (399f6a5e-39c2-416d-971d-ccde6589ba49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-58e0c9b2-b88d-4e5b-bb96-ca4ba5447c15 tempest-SnapshotMetadataTestJSON-1403422676 None] Created volume successfully.
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (8291a927-c970-48c6-a61c-b8e9f9461892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c5e6fb-5b73-4995-b171-c6355a6be018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c5e6fb-5b73-4995-b171-c6355a6be018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2021216638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6886f5e7-6448-46bb-ad6b-999ce812df4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:06Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a208e19-d7d1-45fb-b259-fe79a66b9feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a208e19-d7d1-45fb-b259-fe79a66b9feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6750efb-6870-4e68-a811-122c5a6c7f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6750efb-6870-4e68-a811-122c5a6c7f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6886f5e7-6448-46bb-ad6b-999ce812df4b', 'volume_name': 'volume-6886f5e7-6448-46bb-ad6b-999ce812df4b', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16ef8d1-092e-4bc3-ba0e-e73aad61bd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16ef8d1-092e-4bc3-ba0e-e73aad61bd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d245c2c0-e3b9-4ad1-91ef-5653a6b4b82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:06 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Volume 6886f5e7-6448-46bb-ad6b-999ce812df4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6886f5e7-6448-46bb-ad6b-999ce812df4b', 'volume_size': 1}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2021216638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6886f5e7-6448-46bb-ad6b-999ce812df4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:06Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Creating volume 6886f5e7-6448-46bb-ad6b-999ce812df4b {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:22:06 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:06 devstack sudo[95862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b 1073741824
Sep 29 18:22:06 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:06 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b 1073741824" returned: 0 in 0.627s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:06 devstack sudo[95884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b
Sep 29 18:22:06 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:06 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Flow 'volume_create_manager' (d7a5dfa7-bb93-45bb-ac5d-aa43180121f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d73ae9-5ef6-4494-8951-9cea0a3d01f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d73ae9-5ef6-4494-8951-9cea0a3d01f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1872938766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1733e5e9-6662-4e1c-8a5e-ac62a64cad7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bc5b1a694f45afa7ff222e65c7ab02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:07Z,use_quota=True,user_id='2ec9fb06faf34e97a96a48ae0d00493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe21974b-8fb0-4d56-a98b-299b4758abbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe21974b-8fb0-4d56-a98b-299b4758abbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c875fe7-a8f7-4253-93b1-c15c4ac0220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c875fe7-a8f7-4253-93b1-c15c4ac0220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1733e5e9-6662-4e1c-8a5e-ac62a64cad7f', 'volume_name': 'volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873f5744-2e07-457b-8948-87c6242674ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873f5744-2e07-457b-8948-87c6242674ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d772741-9ea1-42c4-8f26-74b0231e7846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:07 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Volume 1733e5e9-6662-4e1c-8a5e-ac62a64cad7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f', 'volume_size': 1}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:07 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b" returned: 0 in 0.303s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.969s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d245c2c0-e3b9-4ad1-91ef-5653a6b4b82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6886f5e7-6448-46bb-ad6b-999ce812df4b', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ad88ec-b467-410d-9cfd-e1470dff9bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] Creating offline snapshot 1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 of volume aeaf5208-abef-464c-963c-7c5cba3948da {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:22:07 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Volume volume-6886f5e7-6448-46bb-ad6b-999ce812df4b (6886f5e7-6448-46bb-ad6b-999ce812df4b): created successfully
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ad88ec-b467-410d-9cfd-e1470dff9bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (8291a927-c970-48c6-a61c-b8e9f9461892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb7d6cf-253c-4c1f-ab3a-7dc5ec354b94]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:07 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-aff1d843-8086-4379-bd91-4457a5137a0c tempest-VolumesGetTest-1169938720 None] Created volume successfully.
Sep 29 18:22:07 devstack sudo[95887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da
Sep 29 18:22:07 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:07 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da" returned: 0 in 0.449s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:07 devstack sudo[95894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 1G
Sep 29 18:22:07 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:08 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 1G" returned: 0 in 0.604s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeaf5208-abef-464c-963c-7c5cba3948da -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:08 devstack sudo[95899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeaf5208-abef-464c-963c-7c5cba3948da -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96
Sep 29 18:22:08 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:22:08 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (41b0b27c-9234-4c98-95d3-b0e8a77bcfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e34283-8d77-4b02-a628-fe004aefd1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeaf5208-abef-464c-963c-7c5cba3948da -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96" returned: 0 in 0.486s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:08 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 is being set with open permissions: ugo+rw
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e34283-8d77-4b02-a628-fe004aefd1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1757417167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabcfd07-8c6d-4d32-9e14-9dee250f27bd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=6886f5e7-6448-46bb-ad6b-999ce812df4b,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:09Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:08 devstack sudo[95905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96
Sep 29 18:22:08 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5e616f-ec21-47b0-88bc-94a454bd6bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5e616f-ec21-47b0-88bc-94a454bd6bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188f45ee-1aa0-40dd-b9d0-07a5e7a5243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188f45ee-1aa0-40dd-b9d0-07a5e7a5243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'aabcfd07-8c6d-4d32-9e14-9dee250f27bd', 'volume_name': 'volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd', 'volume_size': 1, 'source_volid': '6886f5e7-6448-46bb-ad6b-999ce812df4b', 'source_volstatus': 'available'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901cbf2f-4caf-444a-90c4-03ee8fdafa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901cbf2f-4caf-444a-90c4-03ee8fdafa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e66925-8dc9-428b-9dd9-800e420e6f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:08 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Volume aabcfd07-8c6d-4d32-9e14-9dee250f27bd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd', 'volume_size': 1, 'source_volid': '6886f5e7-6448-46bb-ad6b-999ce812df4b', 'source_volstatus': 'available'}
Sep 29 18:22:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:09 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96" returned: 0 in 0.328s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:09 devstack sudo[95908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.info
Sep 29 18:22:09 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:09 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.info" returned: 0 in 0.304s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:09 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.info is being set with open permissions: ugo+rw
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:09 devstack sudo[95911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.info
Sep 29 18:22:09 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:09 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.info" returned: 0 in 0.313s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.632s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.777s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1872938766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1733e5e9-6662-4e1c-8a5e-ac62a64cad7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bc5b1a694f45afa7ff222e65c7ab02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:07Z,use_quota=True,user_id='2ec9fb06faf34e97a96a48ae0d00493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Creating volume 1733e5e9-6662-4e1c-8a5e-ac62a64cad7f {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:22:09 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:22:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:09 devstack sudo[95915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f 1073741824
Sep 29 18:22:09 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:09 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-44982461-08a5-4f55-9391-77f02ffbd36b tempest-SnapshotMetadataTestJSON-1403422676 None] Create snapshot completed successfully
Sep 29 18:22:10 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f 1073741824" returned: 0 in 0.674s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:10 devstack sudo[95935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f
Sep 29 18:22:10 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:10 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f" returned: 0 in 0.412s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.085s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:11 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Cloning volume 6886f5e7-6448-46bb-ad6b-999ce812df4b to volume aabcfd07-8c6d-4d32-9e14-9dee250f27bd
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d772741-9ea1-42c4-8f26-74b0231e7846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c7d937-2117-415b-b8f9-88cc0ca6efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:11 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Volume volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f (1733e5e9-6662-4e1c-8a5e-ac62a64cad7f): created successfully
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c7d937-2117-415b-b8f9-88cc0ca6efef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Flow 'volume_create_manager' (d7a5dfa7-bb93-45bb-ac5d-aa43180121f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Creating offline snapshot 58d0ce43-4b22-451f-bd0f-fea94136ce96 of volume 6886f5e7-6448-46bb-ad6b-999ce812df4b {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:22:11 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-b44fd0bd-b132-4a43-a5d1-778a8269566a tempest-AttachVolumeNegativeTest-103688396 None] Created volume successfully.
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0967909-4c56-4c41-a527-329bce854ed5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Acquiring lock "cinder-1434fb11-5a2f-48ce-adfe-01a9b4b1bd96-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:11 devstack sudo[95942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b
Sep 29 18:22:11 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "cinder-1434fb11-5a2f-48ce-adfe-01a9b4b1bd96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Acquiring lock "cinder-quobyte-aeaf5208-abef-464c-963c-7c5cba3948da" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "cinder-quobyte-aeaf5208-abef-464c-963c-7c5cba3948da" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Acquiring lock "cinder-quobyte-1434fb11-5a2f-48ce-adfe-01a9b4b1bd96" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "cinder-quobyte-1434fb11-5a2f-48ce-adfe-01a9b4b1bd96" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Deleting offline snapshot 1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 of volume aeaf5208-abef-464c-963c-7c5cba3948da {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] snapshot_file for this snap is: volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f29e52-1aca-4c81-92cd-7de03e807dd7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:11 devstack sudo[95948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96
Sep 29 18:22:11 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:11 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b" returned: 0 in 0.597s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:11 devstack sudo[95953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96 1G
Sep 29 18:22:11 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:12 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96" returned: 0 in 0.552s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeaf5208-abef-464c-963c-7c5cba3948da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bce9819-2418-4ae4-9aa9-37bc731f8016]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:12 devstack sudo[95961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da
Sep 29 18:22:12 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:12 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96 1G" returned: 0 in 0.610s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6886f5e7-6448-46bb-ad6b-999ce812df4b -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:12 devstack sudo[95974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6886f5e7-6448-46bb-ad6b-999ce812df4b -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96
Sep 29 18:22:12 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-8a7de644-f1ef-4400-8605-e7b433b54675 req-b56db400-f1e7-455b-9f6e-82c50df7daed tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:12 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da" returned: 0 in 0.451s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:12 devstack sudo[95980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96
Sep 29 18:22:12 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:12 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6886f5e7-6448-46bb-ad6b-999ce812df4b -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96" returned: 0 in 0.356s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:12 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96 is being set with open permissions: ugo+rw
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:12 devstack sudo[95985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96
Sep 29 18:22:12 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:12 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96" returned: 0 in 0.392s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:13 devstack sudo[95992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96
Sep 29 18:22:13 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:13 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96" returned: 0 in 0.313s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:13 devstack sudo[95994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.info
Sep 29 18:22:13 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:13 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da.1434fb11-5a2f-48ce-adfe-01a9b4b1bd96" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "cinder-quobyte-1434fb11-5a2f-48ce-adfe-01a9b4b1bd96" released by "_delete_snapshot" :: held 1.843s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "cinder-quobyte-aeaf5208-abef-464c-963c-7c5cba3948da" released by "delete_snapshot" :: held 1.874s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:13 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.info" returned: 0 in 0.322s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:13 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.info is being set with open permissions: ugo+rw
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Created reservations ['23718023-1553-4f59-a1ba-47c4697ec1d4', '02d05bcc-2d90-420d-b2c2-27a574f134f5', 'dbbe0bf1-3165-4d4d-86cb-47fe4c7594f6', '10feab63-0dd0-4dda-9cc7-0ae4069b32f6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:22:13 devstack sudo[95998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.info
Sep 29 18:22:13 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:13 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Delete snapshot completed successfully.
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1c438e4a-a969-4d8a-8d47-be89e694c44c tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "cinder-1434fb11-5a2f-48ce-adfe-01a9b4b1bd96-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Acquiring lock "cinder-aeaf5208-abef-464c-963c-7c5cba3948da-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "cinder-aeaf5208-abef-464c-963c-7c5cba3948da-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Acquiring lock "cinder-quobyte-aeaf5208-abef-464c-963c-7c5cba3948da" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "cinder-quobyte-aeaf5208-abef-464c-963c-7c5cba3948da" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:13 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.info" returned: 0 in 0.383s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-quobyte-aabcfd07-8c6d-4d32-9e14-9dee250f27bd" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9531682-c9f5-4715-addf-7fe838cb7c56]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-aabcfd07-8c6d-4d32-9e14-9dee250f27bd" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] snapshot: 58d0ce43-4b22-451f-bd0f-fea94136ce96, volume: aabcfd07-8c6d-4d32-9e14-9dee250f27bd,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5c106d-4fbd-4832-859a-abdede7a80ac]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:13 devstack sudo[96001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da
Sep 29 18:22:13 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:14 devstack sudo[96002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96
Sep 29 18:22:14 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:14 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da" returned: 0 in 0.424s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:14 devstack sudo[96011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da
Sep 29 18:22:14 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:14 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96" returned: 0 in 0.456s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6886f5e7-6448-46bb-ad6b-999ce812df4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9dec28-788f-4e67-84a3-fd0d030b80a0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:14 devstack sudo[96014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b
Sep 29 18:22:14 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:14 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aeaf5208-abef-464c-963c-7c5cba3948da" returned: 0 in 0.296s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "cinder-quobyte-aeaf5208-abef-464c-963c-7c5cba3948da" released by "delete_volume" :: held 0.804s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Created reservations ['d6c2635b-6125-419e-8f78-f52e9cc8880b', '65747397-01d9-4e19-a621-b3e5858ecc6d', 'acc2a3d1-365e-4c35-a962-93b25a3c3564', '95d7d003-089e-49d6-a5ed-56f0f39de323'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:14 devstack sudo[96020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:22:14 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:14 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b" returned: 0 in 0.440s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:22:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:14 devstack sudo[96022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd
Sep 29 18:22:14 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:15 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.354s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:15 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:22:15 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Deleted volume successfully.
Sep 29 18:22:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a185ff0-09fa-4541-b7e6-adb904d9c385 tempest-SnapshotMetadataTestJSON-1403422676 None] Lock "cinder-aeaf5208-abef-464c-963c-7c5cba3948da-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:23 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd" returned: 0 in 8.761s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:23 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b, size 1024.00 MB, duration 8.76 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:22:23 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Converted 1024.00 MB image at 116.88 MB/s
Sep 29 18:22:23 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd is being set with open permissions: ugo+rw
Sep 29 18:22:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:23 devstack sudo[96105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd
Sep 29 18:22:23 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:23 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd" returned: 0 in 0.257s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-aabcfd07-8c6d-4d32-9e14-9dee250f27bd" released by "_copy_volume_from_snapshot" :: held 9.998s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-quobyte-58d0ce43-4b22-451f-bd0f-fea94136ce96" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-58d0ce43-4b22-451f-bd0f-fea94136ce96" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Deleting offline snapshot 58d0ce43-4b22-451f-bd0f-fea94136ce96 of volume 6886f5e7-6448-46bb-ad6b-999ce812df4b {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:22:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] snapshot_file for this snap is: volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:22:23 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab90bd82-58ef-4eb6-95e0-30272ad2a7e2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:24 devstack sudo[96108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96
Sep 29 18:22:24 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:24 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96" returned: 0 in 0.389s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6886f5e7-6448-46bb-ad6b-999ce812df4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:22:24 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bf9c3a-2c84-4e14-a93e-b1c489ce16a6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:24 devstack sudo[96113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b
Sep 29 18:22:24 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:24 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b" returned: 0 in 0.591s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:24 devstack sudo[96118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96
Sep 29 18:22:24 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:24 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Flow 'volume_create_manager' (17ff6d98-e0e8-4bf4-8908-85d2fe995853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db734e9-7d1b-4bb8-b8e2-b93907201155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db734e9-7d1b-4bb8-b8e2-b93907201155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-792401002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da4f4cb-c60e-4f9d-aefc-ebe1096831c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986d3da380174a1a9ee3fa0f020dae8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:25Z,use_quota=True,user_id='0395e4c265ae4721b31bab13db033436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b344140b-0b5e-4816-aee6-e9692687dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b344140b-0b5e-4816-aee6-e9692687dd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff98689-d75f-4d97-926d-f4599d1baca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff98689-d75f-4d97-926d-f4599d1baca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da4f4cb-c60e-4f9d-aefc-ebe1096831c2', 'volume_name': 'volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81c114f-909f-4027-b4de-fe12c4272b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81c114f-909f-4027-b4de-fe12c4272b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13746ab5-0d70-4778-9759-57c4933a8a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:25 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Volume 2da4f4cb-c60e-4f9d-aefc-ebe1096831c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2', 'volume_size': 1}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:25 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96" returned: 0 in 0.340s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:25 devstack sudo[96124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96
Sep 29 18:22:25 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:25 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b.58d0ce43-4b22-451f-bd0f-fea94136ce96" returned: 0 in 0.241s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-58d0ce43-4b22-451f-bd0f-fea94136ce96" released by "_delete_snapshot" :: held 1.652s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.550s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-8a7de644-f1ef-4400-8605-e7b433b54675 req-b56db400-f1e7-455b-9f6e-82c50df7daed tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.122s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-8a7de644-f1ef-4400-8605-e7b433b54675 req-b56db400-f1e7-455b-9f6e-82c50df7daed tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.506s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-792401002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da4f4cb-c60e-4f9d-aefc-ebe1096831c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986d3da380174a1a9ee3fa0f020dae8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:25Z,use_quota=True,user_id='0395e4c265ae4721b31bab13db033436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Creating volume 2da4f4cb-c60e-4f9d-aefc-ebe1096831c2 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:22:25 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e66925-8dc9-428b-9dd9-800e420e6f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd', 'volume_size': 1, 'source_volid': '6886f5e7-6448-46bb-ad6b-999ce812df4b', 'source_volstatus': 'available'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22560c3-c61f-4ff0-9cba-ea3d81bbe545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:25 devstack sudo[96127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2 1073741824
Sep 29 18:22:25 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:25 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Volume volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd (aabcfd07-8c6d-4d32-9e14-9dee250f27bd): created successfully
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22560c3-c61f-4ff0-9cba-ea3d81bbe545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (41b0b27c-9234-4c98-95d3-b0e8a77bcfe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-8a7de644-f1ef-4400-8605-e7b433b54675 req-b56db400-f1e7-455b-9f6e-82c50df7daed tempest-AttachVolumeNegativeTest-103688396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05ccc0eb-43f0-43a9-85cd-9ebcb8ecc30a', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:22:25 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e0ceaeea-b706-4803-970c-90b9db5d2cfa tempest-VolumesGetTest-1169938720 None] Created volume successfully.
Sep 29 18:22:25 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-8a7de644-f1ef-4400-8605-e7b433b54675 req-b56db400-f1e7-455b-9f6e-82c50df7daed tempest-AttachVolumeNegativeTest-103688396 None] attachment_update completed successfully.
Sep 29 18:22:26 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2 1073741824" returned: 0 in 0.598s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:26 devstack sudo[96138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2
Sep 29 18:22:26 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:26 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2" returned: 0 in 0.291s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13746ab5-0d70-4778-9759-57c4933a8a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ceaedf-74ef-468f-b008-98104724effd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Volume volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2 (2da4f4cb-c60e-4f9d-aefc-ebe1096831c2): created successfully
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ceaedf-74ef-468f-b008-98104724effd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Flow 'volume_create_manager' (17ff6d98-e0e8-4bf4-8908-85d2fe995853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fa76efaf-2cf5-4e46-a8f6-feca4abfb53f tempest-VolumesTransfersV355Test-1635152796 None] Created volume successfully.
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (253d3bde-95e5-453b-89d2-2eec3115c8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030acc1c-2cfd-4eee-b213-038b8ae97b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030acc1c-2cfd-4eee-b213-038b8ae97b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1161195475',display_name='tempest-VolumesGetTest-Volume-1476734703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbc33b6-41a6-452f-b73c-35216e82e9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:27Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c89bc0-8b09-4cb1-988a-b280bbb130c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c89bc0-8b09-4cb1-988a-b280bbb130c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5e26a5-618c-4d24-84f1-7760251f2ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5e26a5-618c-4d24-84f1-7760251f2ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bbc33b6-41a6-452f-b73c-35216e82e9d4', 'volume_name': 'volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26712d2e-0caf-45fd-8f55-0dd2ca622a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26712d2e-0caf-45fd-8f55-0dd2ca622a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17c90cf-aef8-405f-8692-1ba5e133d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Volume 6bbc33b6-41a6-452f-b73c-35216e82e9d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4', 'volume_size': 1}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1161195475',display_name='tempest-VolumesGetTest-Volume-1476734703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbc33b6-41a6-452f-b73c-35216e82e9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:27Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Creating volume 6bbc33b6-41a6-452f-b73c-35216e82e9d4 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:22:26 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:22:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:26 devstack sudo[96141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4 1073741824
Sep 29 18:22:26 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:27 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4 1073741824" returned: 0 in 0.684s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:27 devstack sudo[96148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4
Sep 29 18:22:27 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:28 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4" returned: 0 in 0.434s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:22:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17c90cf-aef8-405f-8692-1ba5e133d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5dfd92-4c70-48b4-a9ff-ecb9c3aa4aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:28 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Volume volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4 (6bbc33b6-41a6-452f-b73c-35216e82e9d4): created successfully
Sep 29 18:22:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5dfd92-4c70-48b4-a9ff-ecb9c3aa4aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (253d3bde-95e5-453b-89d2-2eec3115c8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:28 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-7875c89c-c12e-47c6-9a8e-c6b63ac0ea76 tempest-VolumesGetTest-1169938720 None] Created volume successfully.
Sep 29 18:22:28 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-74f455e4-a9a7-431f-a725-8b4e13611425 tempest-VolumesTransfersV355Test-636260785 None] Transfer volume completed successfully.
Sep 29 18:22:28 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-36d9e9ed-a5cf-41a4-ada0-87fc536c9510 req-fd1c2b30-451c-4b81-b74b-f0b519276f5e tempest-AttachVolumeNegativeTest-103688396 None] Terminate volume connection completed successfully.
Sep 29 18:22:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-36d9e9ed-a5cf-41a4-ada0-87fc536c9510 req-fd1c2b30-451c-4b81-b74b-f0b519276f5e tempest-AttachVolumeNegativeTest-103688396 None] Deleting attachment 05ccc0eb-43f0-43a9-85cd-9ebcb8ecc30a. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:22:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Acquiring lock "cinder-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Lock "cinder-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Acquiring lock "cinder-quobyte-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Lock "cinder-quobyte-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2" acquired by "delete_volume" :: waited 0.036s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d80efe-2b72-46b8-9300-948f55550b45]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-6bbc33b6-41a6-452f-b73c-35216e82e9d4-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Lock "cinder-6bbc33b6-41a6-452f-b73c-35216e82e9d4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:29 devstack sudo[96160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2
Sep 29 18:22:29 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-quobyte-6bbc33b6-41a6-452f-b73c-35216e82e9d4" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-6bbc33b6-41a6-452f-b73c-35216e82e9d4" acquired by "delete_volume" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ead1b50-3096-40b9-a7b5-3e9859568d52]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:29 devstack sudo[96164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4
Sep 29 18:22:29 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:29 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2" returned: 0 in 0.579s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:29 devstack sudo[96172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2
Sep 29 18:22:29 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:29 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-01a85a43-a5d5-4ac5-aafa-fb48b3a8f89d req-a73522a0-d482-4507-b21f-b9414b880679 tempest-AttachVolumeTestJSON-623007192 None] Terminate volume connection completed successfully.
Sep 29 18:22:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-01a85a43-a5d5-4ac5-aafa-fb48b3a8f89d req-a73522a0-d482-4507-b21f-b9414b880679 tempest-AttachVolumeTestJSON-623007192 None] Deleting attachment 4af48b79-b326-4bd6-8f1a-7279a5afa166. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:22:30 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4" returned: 0 in 0.517s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:30 devstack sudo[96187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4
Sep 29 18:22:30 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:30 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2" returned: 0 in 0.363s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Lock "cinder-quobyte-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2" released by "delete_volume" :: held 1.173s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Created reservations ['2e19e565-123c-416c-870d-961d14291c4c', '98e903de-1b97-497a-841c-5e2aa9458ff0', 'e224c9bd-764f-4ca5-82d6-9f7533759f17', 'eddc236d-bb08-4292-b286-10f4c98a930d'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:22:30 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6bbc33b6-41a6-452f-b73c-35216e82e9d4" returned: 0 in 0.532s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-6bbc33b6-41a6-452f-b73c-35216e82e9d4" released by "delete_volume" :: held 1.145s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:30 devstack sudo[96211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:22:30 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Created reservations ['95e174a1-e852-4626-8d2a-11bae1efd653', 'ed881439-898a-4f10-bf8b-2739b51449ec', '7aa28cb1-91d8-4ff9-8a21-6c869e9e3fe1', 'd0a48774-c420-4f3a-98a5-5dd849ca3d06'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:30 devstack sudo[96216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:22:30 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:30 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.406s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:30 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:22:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Deleted volume successfully.
Sep 29 18:22:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb15a609-6a96-4399-9951-609aa81e7854 tempest-VolumesTransfersV355Test-35799376 None] Lock "cinder-2da4f4cb-c60e-4f9d-aefc-ebe1096831c2-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:31 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.345s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:31 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:22:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Deleted volume successfully.
Sep 29 18:22:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-18a3f08f-39eb-49f5-8949-8d82f486a9ae tempest-VolumesGetTest-1169938720 None] Lock "cinder-6bbc33b6-41a6-452f-b73c-35216e82e9d4-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-aabcfd07-8c6d-4d32-9e14-9dee250f27bd-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Lock "cinder-aabcfd07-8c6d-4d32-9e14-9dee250f27bd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-quobyte-aabcfd07-8c6d-4d32-9e14-9dee250f27bd" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-aabcfd07-8c6d-4d32-9e14-9dee250f27bd" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:31 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b83a7de-d10d-4fd1-9a87-a1d4db39c4cd]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:32 devstack sudo[96230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd
Sep 29 18:22:32 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Flow 'volume_create_manager' (c59513bb-c209-4134-ba85-62583047aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15869e9b-452f-4dc5-bb8c-93feefc2ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15869e9b-452f-4dc5-bb8c-93feefc2ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2066669831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70b721b-8a03-42e7-a208-aa68ae724dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986d3da380174a1a9ee3fa0f020dae8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:32Z,use_quota=True,user_id='0395e4c265ae4721b31bab13db033436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2416aa-3af9-4666-b919-67e83a430e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2416aa-3af9-4666-b919-67e83a430e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df6da28-9812-43fc-86e5-85a04c2dc908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df6da28-9812-43fc-86e5-85a04c2dc908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70b721b-8a03-42e7-a208-aa68ae724dfb', 'volume_name': 'volume-c70b721b-8a03-42e7-a208-aa68ae724dfb', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6391a016-ae84-4b1f-b24c-690135410566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6391a016-ae84-4b1f-b24c-690135410566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94cbe58d-718f-44ab-bc42-665d6d242bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:32 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Volume c70b721b-8a03-42e7-a208-aa68ae724dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70b721b-8a03-42e7-a208-aa68ae724dfb', 'volume_size': 1}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2066669831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70b721b-8a03-42e7-a208-aa68ae724dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986d3da380174a1a9ee3fa0f020dae8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:32Z,use_quota=True,user_id='0395e4c265ae4721b31bab13db033436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Creating volume c70b721b-8a03-42e7-a208-aa68ae724dfb {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:22:32 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:22:32 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd" returned: 0 in 0.496s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:32 devstack sudo[96237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb 1073741824
Sep 29 18:22:32 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:32 devstack sudo[96238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd
Sep 29 18:22:32 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:32 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-aabcfd07-8c6d-4d32-9e14-9dee250f27bd" returned: 0 in 0.443s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-aabcfd07-8c6d-4d32-9e14-9dee250f27bd" released by "delete_volume" :: held 1.015s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Created reservations ['6697624d-491e-4151-bc30-88502c07c259', '7d6bc2bb-e3bb-4dc0-ba86-4f8ed7cb2e88', 'e657b43b-94a5-4cca-93ca-79b648471f62', 'a07ac6ee-3078-4d94-9764-5b29bfac915d'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:22:33 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb 1073741824" returned: 0 in 0.677s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:33 devstack sudo[96247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb
Sep 29 18:22:33 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:33 devstack sudo[96249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:22:33 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:33 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb" returned: 0 in 0.317s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94cbe58d-718f-44ab-bc42-665d6d242bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70b721b-8a03-42e7-a208-aa68ae724dfb', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5cd6e0-61ba-4648-b06f-136f5dddfa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:33 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Volume volume-c70b721b-8a03-42e7-a208-aa68ae724dfb (c70b721b-8a03-42e7-a208-aa68ae724dfb): created successfully
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5cd6e0-61ba-4648-b06f-136f5dddfa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Flow 'volume_create_manager' (c59513bb-c209-4134-ba85-62583047aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:33 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-046819a1-78de-4603-945a-5a80613757f4 tempest-VolumesTransfersV355Test-1635152796 None] Created volume successfully.
Sep 29 18:22:33 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.350s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:22:33 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Deleted volume successfully.
Sep 29 18:22:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3906c9b7-395c-4344-a026-ef5bed6a6163 tempest-VolumesGetTest-1169938720 None] Lock "cinder-aabcfd07-8c6d-4d32-9e14-9dee250f27bd-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-6886f5e7-6448-46bb-ad6b-999ce812df4b-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Lock "cinder-6886f5e7-6448-46bb-ad6b-999ce812df4b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-quobyte-6886f5e7-6448-46bb-ad6b-999ce812df4b" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-6886f5e7-6448-46bb-ad6b-999ce812df4b" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:34 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[522220f5-8c12-4fe3-b299-7f0bdbf7fdb6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:34 devstack sudo[96274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b
Sep 29 18:22:34 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:35 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b" returned: 0 in 0.572s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:35 devstack sudo[96285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b
Sep 29 18:22:35 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Acquiring lock "cinder-c70b721b-8a03-42e7-a208-aa68ae724dfb-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Lock "cinder-c70b721b-8a03-42e7-a208-aa68ae724dfb-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Acquiring lock "cinder-quobyte-c70b721b-8a03-42e7-a208-aa68ae724dfb" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Lock "cinder-quobyte-c70b721b-8a03-42e7-a208-aa68ae724dfb" acquired by "delete_volume" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[063e0dfb-5c9c-4d35-a007-fc4ca89a85ff]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:35 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6886f5e7-6448-46bb-ad6b-999ce812df4b" returned: 0 in 0.473s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-6886f5e7-6448-46bb-ad6b-999ce812df4b" released by "delete_volume" :: held 1.191s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:35 devstack sudo[96319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb
Sep 29 18:22:35 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Created reservations ['25a92cce-02e3-4614-a71b-f73992d1532a', 'e2126c99-a1be-4927-9723-9c0546a021f3', '92bca6ed-bbf8-4945-a115-3b0cbab9705f', '0afa0433-5f9b-4c88-b04b-c6912c77c01f'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:35 devstack sudo[96333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:22:35 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:36 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb" returned: 0 in 0.604s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:36 devstack sudo[96348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb
Sep 29 18:22:36 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:36 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.407s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:22:36 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Deleted volume successfully.
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e774d24-2cb3-4deb-9a16-40ae102425b2 tempest-VolumesGetTest-1169938720 None] Lock "cinder-6886f5e7-6448-46bb-ad6b-999ce812df4b-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:36 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c70b721b-8a03-42e7-a208-aa68ae724dfb" returned: 0 in 0.427s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Lock "cinder-quobyte-c70b721b-8a03-42e7-a208-aa68ae724dfb" released by "delete_volume" :: held 1.138s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Created reservations ['7773b9fa-16d9-41a4-9e36-91dc8ca9f7a4', 'f2d6f0aa-ecc4-45e0-a376-fc7d408cdd95', 'feffd849-523a-4b8a-aba6-b47475f53656', 'b5c22438-e819-473b-a59b-a85ab4609db9'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=117,cinder:INSERT=29,cinder:SELECT=98,cinder:DELETE=8 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=126,cinder:SELECT=99,cinder:DELETE=13,cinder:INSERT=29 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:36 devstack sudo[96366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:22:36 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:37 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.321s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:37 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:22:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Deleted volume successfully.
Sep 29 18:22:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-112372f9-20c2-493a-aa92-fb5b7e5b7889 tempest-VolumesTransfersV355Test-35799376 None] Lock "cinder-c70b721b-8a03-42e7-a208-aa68ae724dfb-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:38 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:22:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (f931776f-e3da-42a1-906a-0df837bc1817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006704fa-7048-4c49-aaa0-76a7a8b27a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006704fa-7048-4c49-aaa0-76a7a8b27a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1448974026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec52e91a-65ba-489a-adea-4979b4dd27e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:38Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3867eae-7987-4e66-a774-e11673c767b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3867eae-7987-4e66-a774-e11673c767b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3772d9-052e-43a6-9ea9-6e9325057ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:38 devstack cinder-volume[86821]: DEBUG cinder.image.glance [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Creating Keystone auth plugin from conf {{(pid=86821) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 18:22:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3772d9-052e-43a6-9ea9-6e9325057ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec52e91a-65ba-489a-adea-4979b4dd27e2', 'volume_name': 'volume-ec52e91a-65ba-489a-adea-4979b4dd27e2', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b96750b60>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09165fc0-0c28-42dd-a5d9-1da087246ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09165fc0-0c28-42dd-a5d9-1da087246ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f476e7-90c6-4ce4-9193-e02e038b3155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:39 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Volume ec52e91a-65ba-489a-adea-4979b4dd27e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec52e91a-65ba-489a-adea-4979b4dd27e2', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b96750b60>}
Sep 29 18:22:39 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Trying to clone ec52e91a-65ba-489a-adea-4979b4dd27e2 from image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]). {{(pid=86821) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 18:22:39 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 18:22:39 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 18:22:39 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d1affc-6d90-471a-a5ea-66841f5c5738]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:40 devstack sudo[96391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD
Sep 29 18:22:40 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:40 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:40 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Temporary image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb is fetched for user 4a51c7060bf74ac9a25f42b4bee86b3c. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 18:22:40 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86310ae-7728-4a1d-8905-0b7ed37a471c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:40 devstack sudo[96396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD
Sep 29 18:22:40 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:41 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1448974026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec52e91a-65ba-489a-adea-4979b4dd27e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:38Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Creating volume ec52e91a-65ba-489a-adea-4979b4dd27e2 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:22:41 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:41 devstack sudo[96402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 1073741824
Sep 29 18:22:41 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:41 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 1073741824" returned: 0 in 0.704s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:41 devstack sudo[96408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2
Sep 29 18:22:41 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:42 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2" returned: 0 in 0.328s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:22:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:42 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Attempting download of d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb ((None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}])) to volume ec52e91a-65ba-489a-adea-4979b4dd27e2. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 18:22:42 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea508b14-9dff-4de4-8a18-12bd7cf052a8]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_1nvz3zk7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:42 devstack sudo[96412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_1nvz3zk7
Sep 29 18:22:42 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:43 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_1nvz3zk7" returned: 0 in 0.603s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_1nvz3zk7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:43 devstack sudo[96420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_1nvz3zk7
Sep 29 18:22:43 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:43 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_1nvz3zk7" returned: 1 in 0.739s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_1nvz3zk7' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:22:43 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7dde7e-73f2-40be-97d0-3697f0619ca1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:44 devstack sudo[96435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD
Sep 29 18:22:44 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:44 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:44 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb was qcow2, converting to qcow2 {{(pid=86821) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 18:22:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:44 devstack sudo[96445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2
Sep 29 18:22:44 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:47 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2" returned: 0 in 3.323s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:47 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_k_qz1n7ldevstack@QuobyteHD, size 112.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:22:47 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Converted 112.00 MB image at 33.69 MB/s
Sep 29 18:22:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:47 devstack sudo[96468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 1G
Sep 29 18:22:47 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:48 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 1G" returned: 0 in 0.929s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:48 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Downloaded image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb ((None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}])) to volume ec52e91a-65ba-489a-adea-4979b4dd27e2 successfully. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 18:22:48 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Temporary image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb for user 4a51c7060bf74ac9a25f42b4bee86b3c is deleted. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 18:22:48 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Marking volume ec52e91a-65ba-489a-adea-4979b4dd27e2 as bootable. {{(pid=86821) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 18:22:48 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Copying metadata from image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb to ec52e91a-65ba-489a-adea-4979b4dd27e2. {{(pid=86821) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 18:22:48 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Creating volume glance metadata for volume ec52e91a-65ba-489a-adea-4979b4dd27e2 backed by image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86821) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 18:22:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f476e7-90c6-4ce4-9193-e02e038b3155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec52e91a-65ba-489a-adea-4979b4dd27e2', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b96750b60>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e618b38d-806f-4cfe-b2c2-869da3b7238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:49 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Volume volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 (ec52e91a-65ba-489a-adea-4979b4dd27e2): created successfully
Sep 29 18:22:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e618b38d-806f-4cfe-b2c2-869da3b7238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (f931776f-e3da-42a1-906a-0df837bc1817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:49 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-41c2bcfa-1acd-462f-9386-865922fcc306 tempest-VolumesGetTest-1169938720 None] Created volume successfully.
Sep 29 18:22:50 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:22:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (9af832d8-9952-4e27-a690-2ec2d65fc871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08612e5a-9c58-4986-82ef-a26793d2b7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08612e5a-9c58-4986-82ef-a26793d2b7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-329521885',display_name='tempest-VolumesGetTest-Volume-1776696523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad15babf-57ce-4a30-a2ae-bfebba2c7bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:51Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bb5d83-6195-4eaa-bc2a-7b543f064290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bb5d83-6195-4eaa-bc2a-7b543f064290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e4bf6b8-a64a-4061-92d5-9cfceb44c4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e4bf6b8-a64a-4061-92d5-9cfceb44c4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad15babf-57ce-4a30-a2ae-bfebba2c7bfc', 'volume_name': 'volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e76803-65bd-4a3d-aa89-05d2ba82ded3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e76803-65bd-4a3d-aa89-05d2ba82ded3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1552d1b-e252-48bd-87a5-5aa0a4645f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:51 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Volume ad15babf-57ce-4a30-a2ae-bfebba2c7bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc', 'volume_size': 1}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:22:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-329521885',display_name='tempest-VolumesGetTest-Volume-1776696523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad15babf-57ce-4a30-a2ae-bfebba2c7bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f9da6dd47749059ba947e76779e11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:51Z,use_quota=True,user_id='4a51c7060bf74ac9a25f42b4bee86b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Creating volume ad15babf-57ce-4a30-a2ae-bfebba2c7bfc {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:22:51 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:22:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:51 devstack sudo[96544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc 1073741824
Sep 29 18:22:51 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:52 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc 1073741824" returned: 0 in 0.918s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:52 devstack sudo[96551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc
Sep 29 18:22:52 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:52 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc" returned: 0 in 0.411s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:22:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1552d1b-e252-48bd-87a5-5aa0a4645f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca057b44-c9f1-442b-8b67-2fb1797ab4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:22:52 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Volume volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc (ad15babf-57ce-4a30-a2ae-bfebba2c7bfc): created successfully
Sep 29 18:22:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca057b44-c9f1-442b-8b67-2fb1797ab4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:22:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Flow 'volume_create_manager' (9af832d8-9952-4e27-a690-2ec2d65fc871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:22:52 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a1aca021-4ae1-43c1-a5d0-01ccae42d150 tempest-VolumesGetTest-1169938720 None] Created volume successfully.
Sep 29 18:22:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Lock "cinder-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-quobyte-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc" acquired by "delete_volume" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:53 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a118bbc-bab4-46f4-a6f9-6d7dc0b0377e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:53 devstack sudo[96556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc
Sep 29 18:22:53 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:54 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc" returned: 0 in 0.549s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:54 devstack sudo[96563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc
Sep 29 18:22:54 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:54 devstack sudo[96565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:22:54 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:54 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc" returned: 0 in 0.413s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc" released by "delete_volume" :: held 1.066s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Created reservations ['753799fb-1258-4cd6-bf86-5c5ccca9ea85', 'd68df1fe-d14e-4159-9e0d-f4ec202d4235', '9144ab82-32c5-4e02-8774-c799bdf2c022', 'e8bb6226-01f7-4c1b-b85c-62a1ca272500'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:22:54 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.462s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:22:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:22:54 devstack sudo[96569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:22:54 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:55 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.291s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:55 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:22:55 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Deleted volume successfully.
Sep 29 18:22:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9c7a39c7-cb26-4c31-a03e-6812ddb9e2af tempest-VolumesGetTest-1169938720 None] Lock "cinder-ad15babf-57ce-4a30-a2ae-bfebba2c7bfc-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-ec52e91a-65ba-489a-adea-4979b4dd27e2-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Lock "cinder-ec52e91a-65ba-489a-adea-4979b4dd27e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Acquiring lock "cinder-quobyte-ec52e91a-65ba-489a-adea-4979b4dd27e2" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:22:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-ec52e91a-65ba-489a-adea-4979b4dd27e2" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:22:56 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[181d8e22-3b50-4681-8f2c-34bdfb00fc57]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:22:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:56 devstack sudo[96572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2
Sep 29 18:22:56 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:56 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2" returned: 0 in 0.550s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:56 devstack sudo[96577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2
Sep 29 18:22:56 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:56 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ec52e91a-65ba-489a-adea-4979b4dd27e2" returned: 0 in 0.312s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Lock "cinder-quobyte-ec52e91a-65ba-489a-adea-4979b4dd27e2" released by "delete_volume" :: held 0.923s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:22:56 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Created reservations ['326ecee2-ec55-45c3-b45c-efa94dfd7783', '5421160c-43e6-431a-b78a-2a5e08871da8', 'c3391aa2-23f6-442c-a153-39c4eb10b35b', '6118a8d1-050a-40f8-80d3-8377080e30cf'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:22:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:22:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:22:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:22:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:22:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:22:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:22:57 devstack sudo[96580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:22:57 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:22:57 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root
Sep 29 18:22:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.293s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:22:57 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:22:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Deleted volume successfully.
Sep 29 18:22:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfa3525c-ce6e-4499-b1ea-6ba84df602ca tempest-VolumesGetTest-1169938720 None] Lock "cinder-ec52e91a-65ba-489a-adea-4979b4dd27e2-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:04 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:23:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Flow 'volume_create_manager' (6993a9d2-60ed-473b-92d5-5cdea341a104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9d061a-4ced-4424-ad1d-c0c4cecda6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9d061a-4ced-4424-ad1d-c0c4cecda6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-538673818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95349981-bbbd-4057-aeca-70ca1819fd2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='612aa7ecb8fe40558fa88f485616e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:05Z,use_quota=True,user_id='db3c4c7d54f14933aa2e940037059401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0cc6a2-7070-4638-8d0e-7f4bcef79787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0cc6a2-7070-4638-8d0e-7f4bcef79787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57c0064-b4a2-4f3f-ad18-e6f849e8e2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57c0064-b4a2-4f3f-ad18-e6f849e8e2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95349981-bbbd-4057-aeca-70ca1819fd2d', 'volume_name': 'volume-95349981-bbbd-4057-aeca-70ca1819fd2d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae93c9b5-e7c1-42da-859a-65eb1e7873f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae93c9b5-e7c1-42da-859a-65eb1e7873f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ec7319-35b2-4810-bb43-9f8fa721c134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:05 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Volume 95349981-bbbd-4057-aeca-70ca1819fd2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95349981-bbbd-4057-aeca-70ca1819fd2d', 'volume_size': 1}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-538673818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95349981-bbbd-4057-aeca-70ca1819fd2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='612aa7ecb8fe40558fa88f485616e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:05Z,use_quota=True,user_id='db3c4c7d54f14933aa2e940037059401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Creating volume 95349981-bbbd-4057-aeca-70ca1819fd2d {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:23:05 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:05 devstack sudo[96624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d 1073741824
Sep 29 18:23:05 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:05 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d 1073741824" returned: 0 in 0.631s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:05 devstack sudo[96632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d
Sep 29 18:23:05 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:05 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Flow 'volume_create_manager' (4401e8e4-130a-47c5-8deb-1c3514ad4132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a236508-d609-4489-a484-41923b27e1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a236508-d609-4489-a484-41923b27e1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1216523408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdacab6-d30c-4b20-9d98-5c1e30272173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628ee7a1ec674c11aacd66b60ff8132a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:06Z,use_quota=True,user_id='e3b8382fcb8f47d68694dcd75f4359ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7361683-707e-4fbb-a4bb-838ea6b4c69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7361683-707e-4fbb-a4bb-838ea6b4c69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1fa5e3-9083-4799-a092-a8cd655214f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1fa5e3-9083-4799-a092-a8cd655214f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cdacab6-d30c-4b20-9d98-5c1e30272173', 'volume_name': 'volume-5cdacab6-d30c-4b20-9d98-5c1e30272173', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed63a8ff-5774-4de9-bf6d-1383bf85a888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed63a8ff-5774-4de9-bf6d-1383bf85a888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89488f11-c563-4de2-b90d-8fbbc0d8cfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:06 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Volume 5cdacab6-d30c-4b20-9d98-5c1e30272173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cdacab6-d30c-4b20-9d98-5c1e30272173', 'volume_size': 1}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:06 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d" returned: 0 in 0.391s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.069s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1216523408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdacab6-d30c-4b20-9d98-5c1e30272173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628ee7a1ec674c11aacd66b60ff8132a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:06Z,use_quota=True,user_id='e3b8382fcb8f47d68694dcd75f4359ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Creating volume 5cdacab6-d30c-4b20-9d98-5c1e30272173 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:23:06 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ec7319-35b2-4810-bb43-9f8fa721c134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95349981-bbbd-4057-aeca-70ca1819fd2d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0dc811-96d3-4a1b-aeb1-ea77e4169957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:06 devstack sudo[96635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 1073741824
Sep 29 18:23:06 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:06 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Volume volume-95349981-bbbd-4057-aeca-70ca1819fd2d (95349981-bbbd-4057-aeca-70ca1819fd2d): created successfully
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0dc811-96d3-4a1b-aeb1-ea77e4169957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Flow 'volume_create_manager' (6993a9d2-60ed-473b-92d5-5cdea341a104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:06 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-93b813c3-94a1-4c9d-aa4d-6cfc8db137bf tempest-VolumesListTestJSON-2121287079 None] Created volume successfully.
Sep 29 18:23:06 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 1073741824" returned: 0 in 0.473s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:06 devstack sudo[96642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173
Sep 29 18:23:06 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:06 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173" returned: 0 in 0.274s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89488f11-c563-4de2-b90d-8fbbc0d8cfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cdacab6-d30c-4b20-9d98-5c1e30272173', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6333016e-a2d9-4457-bf33-3868bcc06394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:06 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Volume volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 (5cdacab6-d30c-4b20-9d98-5c1e30272173): created successfully
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6333016e-a2d9-4457-bf33-3868bcc06394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Flow 'volume_create_manager' (4401e8e4-130a-47c5-8deb-1c3514ad4132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:07 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-55990c79-f25a-486f-b436-db99167bf39a tempest-VolumesActionsTest-80614654 None] Created volume successfully.
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Flow 'volume_create_manager' (90d7ad87-46cf-4f26-9050-7c720df57d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aaa3689-782e-4c13-9187-2ca216a80484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aaa3689-782e-4c13-9187-2ca216a80484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-556800066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880379f0-5eff-4b89-afab-35b464efdb05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='612aa7ecb8fe40558fa88f485616e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:07Z,use_quota=True,user_id='db3c4c7d54f14933aa2e940037059401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713827ad-4188-4c0a-a097-e1d649a1d163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713827ad-4188-4c0a-a097-e1d649a1d163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27086707-c583-413d-a0d8-417a99da43c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27086707-c583-413d-a0d8-417a99da43c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '880379f0-5eff-4b89-afab-35b464efdb05', 'volume_name': 'volume-880379f0-5eff-4b89-afab-35b464efdb05', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad521f88-8f2e-43e2-b37b-c35246f76a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad521f88-8f2e-43e2-b37b-c35246f76a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceca6e9b-8068-4647-8bad-5dc962fca731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:07 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Volume 880379f0-5eff-4b89-afab-35b464efdb05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-880379f0-5eff-4b89-afab-35b464efdb05', 'volume_size': 1}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-556800066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880379f0-5eff-4b89-afab-35b464efdb05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='612aa7ecb8fe40558fa88f485616e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:07Z,use_quota=True,user_id='db3c4c7d54f14933aa2e940037059401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Creating volume 880379f0-5eff-4b89-afab-35b464efdb05 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:23:07 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:23:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:07 devstack sudo[96645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05 1073741824
Sep 29 18:23:07 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:08 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05 1073741824" returned: 0 in 0.531s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:08 devstack sudo[96651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05
Sep 29 18:23:08 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:08 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05" returned: 0 in 0.301s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:23:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceca6e9b-8068-4647-8bad-5dc962fca731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-880379f0-5eff-4b89-afab-35b464efdb05', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82e6c81-fc41-44cf-af87-7001b0700120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:08 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Volume volume-880379f0-5eff-4b89-afab-35b464efdb05 (880379f0-5eff-4b89-afab-35b464efdb05): created successfully
Sep 29 18:23:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82e6c81-fc41-44cf-af87-7001b0700120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Flow 'volume_create_manager' (90d7ad87-46cf-4f26-9050-7c720df57d3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:08 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e10bc320-5419-4a50-9ae4-9bc4f996b0ed tempest-VolumesListTestJSON-2121287079 None] Created volume successfully.
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Flow 'volume_create_manager' (fb802cd3-8263-4ab0-994f-c7deab763bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ca1fb9-8118-40f7-be6a-41cbbeb8f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ca1fb9-8118-40f7-be6a-41cbbeb8f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1628620145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38a26e2-d957-46c8-98c2-ff3227f0eb15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='612aa7ecb8fe40558fa88f485616e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:10Z,use_quota=True,user_id='db3c4c7d54f14933aa2e940037059401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecba87d1-098c-420a-a1bf-7e8623ee587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecba87d1-098c-420a-a1bf-7e8623ee587b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2317b08-d848-4dfe-89f3-e063013e6c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2317b08-d848-4dfe-89f3-e063013e6c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38a26e2-d957-46c8-98c2-ff3227f0eb15', 'volume_name': 'volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0b270d-b44c-4aef-b642-2bd9d3e8c247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0b270d-b44c-4aef-b642-2bd9d3e8c247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b11ddb-e221-42b7-803d-413bf2a2642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:10 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Volume d38a26e2-d957-46c8-98c2-ff3227f0eb15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15', 'volume_size': 1}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1628620145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38a26e2-d957-46c8-98c2-ff3227f0eb15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='612aa7ecb8fe40558fa88f485616e107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:10Z,use_quota=True,user_id='db3c4c7d54f14933aa2e940037059401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Creating volume d38a26e2-d957-46c8-98c2-ff3227f0eb15 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:23:10 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:23:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:10 devstack sudo[96657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15 1073741824
Sep 29 18:23:10 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:11 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15 1073741824" returned: 0 in 0.944s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:11 devstack sudo[96683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15
Sep 29 18:23:11 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:12 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15" returned: 0 in 0.534s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:23:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b11ddb-e221-42b7-803d-413bf2a2642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae7c1e7-1488-404f-923f-1ae5ae74b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:12 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Volume volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15 (d38a26e2-d957-46c8-98c2-ff3227f0eb15): created successfully
Sep 29 18:23:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae7c1e7-1488-404f-923f-1ae5ae74b33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Flow 'volume_create_manager' (fb802cd3-8263-4ab0-994f-c7deab763bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:12 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-7e61379c-1f0a-4120-b7b8-d1f77127f051 tempest-VolumesListTestJSON-2121287079 None] Created volume successfully.
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Flow 'volume_create_manager' (e43ab9cd-5251-4781-8a46-e9744128e987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8c5ab2-6480-40b1-9e95-a7aebf250c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8c5ab2-6480-40b1-9e95-a7aebf250c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-345979088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719f006c-012a-4330-9911-407ea901d332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bc5b1a694f45afa7ff222e65c7ab02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:15Z,use_quota=True,user_id='2ec9fb06faf34e97a96a48ae0d00493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8b8a55-32c4-4dbd-89ca-37fb5e61cb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8b8a55-32c4-4dbd-89ca-37fb5e61cb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4c5f01-ca66-4a75-a14d-4f4372474e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4c5f01-ca66-4a75-a14d-4f4372474e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '719f006c-012a-4330-9911-407ea901d332', 'volume_name': 'volume-719f006c-012a-4330-9911-407ea901d332', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eff2517-7062-4e2c-93ab-f79c66d57890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eff2517-7062-4e2c-93ab-f79c66d57890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004fb30c-1332-4252-bd95-86e12a610ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:14 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Volume 719f006c-012a-4330-9911-407ea901d332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-719f006c-012a-4330-9911-407ea901d332', 'volume_size': 1}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-345979088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719f006c-012a-4330-9911-407ea901d332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bc5b1a694f45afa7ff222e65c7ab02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:15Z,use_quota=True,user_id='2ec9fb06faf34e97a96a48ae0d00493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Creating volume 719f006c-012a-4330-9911-407ea901d332 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:23:14 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:23:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:14 devstack sudo[96705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332 1073741824
Sep 29 18:23:14 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:15 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332 1073741824" returned: 0 in 0.934s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:16 devstack sudo[96735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332
Sep 29 18:23:16 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "cinder-d38a26e2-d957-46c8-98c2-ff3227f0eb15-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-d38a26e2-d957-46c8-98c2-ff3227f0eb15-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "cinder-quobyte-d38a26e2-d957-46c8-98c2-ff3227f0eb15" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-quobyte-d38a26e2-d957-46c8-98c2-ff3227f0eb15" acquired by "delete_volume" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:16 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332" returned: 0 in 0.527s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004fb30c-1332-4252-bd95-86e12a610ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-719f006c-012a-4330-9911-407ea901d332', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ba4bf9-7ec1-49f8-8008-0705449b8301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10e0daf-2190-4775-8571-e6cc28b5a285]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:16 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Volume volume-719f006c-012a-4330-9911-407ea901d332 (719f006c-012a-4330-9911-407ea901d332): created successfully
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ba4bf9-7ec1-49f8-8008-0705449b8301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Flow 'volume_create_manager' (e43ab9cd-5251-4781-8a46-e9744128e987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:16 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0fb163f8-91af-4639-b41c-161d26756ada tempest-AttachVolumeNegativeTest-103688396 None] Created volume successfully.
Sep 29 18:23:16 devstack sudo[96764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15
Sep 29 18:23:16 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:17 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15" returned: 0 in 0.593s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:17 devstack sudo[96795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15
Sep 29 18:23:17 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:17 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d38a26e2-d957-46c8-98c2-ff3227f0eb15" returned: 0 in 0.463s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-quobyte-d38a26e2-d957-46c8-98c2-ff3227f0eb15" released by "delete_volume" :: held 1.169s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:17 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Created reservations ['630cf8b1-c24a-4ce5-9cae-a6c16ff25891', 'a1b6f426-e898-4654-8df3-fb76d11d70b1', '604cf608-bbe4-4c79-abaf-64077f9326d3', '052be798-338b-45f6-b783-8b4408bac812'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:23:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:17 devstack sudo[96815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:23:17 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:18 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.463s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:18 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:23:18 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Deleted volume successfully.
Sep 29 18:23:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d09152a5-73e0-4c2f-a976-d6e3a78a6b78 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-d38a26e2-d957-46c8-98c2-ff3227f0eb15-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-62f2416e-bc66-4ea9-ae9f-364b7e70ebd3 req-572804c4-3c63-4f95-bfff-d7adccfa6f18 tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-62f2416e-bc66-4ea9-ae9f-364b7e70ebd3 req-572804c4-3c63-4f95-bfff-d7adccfa6f18 tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-62f2416e-bc66-4ea9-ae9f-364b7e70ebd3 req-572804c4-3c63-4f95-bfff-d7adccfa6f18 tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "cinder-880379f0-5eff-4b89-afab-35b464efdb05-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-62f2416e-bc66-4ea9-ae9f-364b7e70ebd3 req-572804c4-3c63-4f95-bfff-d7adccfa6f18 tempest-AttachVolumeNegativeTest-103688396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-719f006c-012a-4330-9911-407ea901d332', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f726f433-ba23-4913-9cb7-65c721728325', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:23:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-880379f0-5eff-4b89-afab-35b464efdb05-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "cinder-quobyte-880379f0-5eff-4b89-afab-35b464efdb05" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:18 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-62f2416e-bc66-4ea9-ae9f-364b7e70ebd3 req-572804c4-3c63-4f95-bfff-d7adccfa6f18 tempest-AttachVolumeNegativeTest-103688396 None] attachment_update completed successfully.
Sep 29 18:23:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-quobyte-880379f0-5eff-4b89-afab-35b464efdb05" acquired by "delete_volume" :: waited 0.044s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:19 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[55936798-0d44-4d6c-b8fc-54cbd14e4d94]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:23:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:19 devstack sudo[96831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05
Sep 29 18:23:19 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:20 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05" returned: 0 in 1.168s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:20 devstack sudo[97273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05
Sep 29 18:23:20 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5753001d-d588-4db4-9d1e-47f0cc85754a tempest-VolumesActionsTest-80614654 None] Acquiring lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173" by "attach_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5753001d-d588-4db4-9d1e-47f0cc85754a tempest-VolumesActionsTest-80614654 None] Lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173" acquired by "attach_volume" :: waited 0.077s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:21 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-880379f0-5eff-4b89-afab-35b464efdb05" returned: 0 in 1.166s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-quobyte-880379f0-5eff-4b89-afab-35b464efdb05" released by "delete_volume" :: held 2.597s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:21 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5753001d-d588-4db4-9d1e-47f0cc85754a tempest-VolumesActionsTest-80614654 None] Attaching volume 5cdacab6-d30c-4b20-9d98-5c1e30272173 to instance 24708d4e-28d1-48e1-9562-2697a3413fde at mountpoint /dev/vdb on host None.
Sep 29 18:23:21 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5753001d-d588-4db4-9d1e-47f0cc85754a tempest-VolumesActionsTest-80614654 None] Attach volume completed successfully.
Sep 29 18:23:21 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Created reservations ['442e296f-c02b-428a-a067-7b82ae133b87', 'f85fded4-a8f0-4ffb-a11d-d9b092d4dd24', '407d1f26-3763-4040-b977-00e5ef563e5a', '4c340047-8aee-44f9-ba3a-23888d57d1db'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:23:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5753001d-d588-4db4-9d1e-47f0cc85754a tempest-VolumesActionsTest-80614654 None] Lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173" released by "attach_volume" :: held 0.646s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:22 devstack sudo[97344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:23:22 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cccba050-75dc-49d7-9783-fdb4c32da608 tempest-VolumesActionsTest-80614654 None] Acquiring lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173-detach_volume" by "detach_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cccba050-75dc-49d7-9783-fdb4c32da608 tempest-VolumesActionsTest-80614654 None] Lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:22 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-cccba050-75dc-49d7-9783-fdb4c32da608 tempest-VolumesActionsTest-80614654 None] Detaching volume 5cdacab6-d30c-4b20-9d98-5c1e30272173 from instance 24708d4e-28d1-48e1-9562-2697a3413fde.
Sep 29 18:23:22 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-cccba050-75dc-49d7-9783-fdb4c32da608 tempest-VolumesActionsTest-80614654 None] Detach volume completed successfully.
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cccba050-75dc-49d7-9783-fdb4c32da608 tempest-VolumesActionsTest-80614654 None] Lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173-detach_volume" released by "detach_volume" :: held 0.191s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:22 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.639s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:23:22 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Deleted volume successfully.
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "cinder-95349981-bbbd-4057-aeca-70ca1819fd2d-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-95349981-bbbd-4057-aeca-70ca1819fd2d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-47284512-7d10-4e6b-8195-498acda60774 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-880379f0-5eff-4b89-afab-35b464efdb05-delete_volume" released by "delete_volume" :: held 4.036s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "cinder-quobyte-95349981-bbbd-4057-aeca-70ca1819fd2d" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-quobyte-95349981-bbbd-4057-aeca-70ca1819fd2d" acquired by "delete_volume" :: waited 0.040s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:23 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c035b169-9c4b-46a4-8be7-d713681f9b5e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:23:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:23 devstack sudo[97368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d
Sep 29 18:23:23 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:23 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d" returned: 0 in 0.639s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:23 devstack sudo[97389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d
Sep 29 18:23:23 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-4d1b05e6-6b16-4189-9741-f1e6b289ef32 req-531e8589-f357-4227-a5b0-741ff6053cf2 tempest-AttachVolumeNegativeTest-103688396 None] Terminate volume connection completed successfully.
Sep 29 18:23:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-4d1b05e6-6b16-4189-9741-f1e6b289ef32 req-531e8589-f357-4227-a5b0-741ff6053cf2 tempest-AttachVolumeNegativeTest-103688396 None] Deleting attachment f726f433-ba23-4913-9cb7-65c721728325. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:23:24 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95349981-bbbd-4057-aeca-70ca1819fd2d" returned: 0 in 0.627s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-quobyte-95349981-bbbd-4057-aeca-70ca1819fd2d" released by "delete_volume" :: held 1.426s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:24 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Created reservations ['9047b11e-2552-40a3-9149-b752f96bd6c9', '2dbd2d46-55ce-4d13-8a24-8db797f120b3', '674cecf6-2492-443f-a3cf-c97d7917a6ba', 'd67e4af4-9627-4367-83f0-7cd05d27f070'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:23:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:24 devstack sudo[97431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:23:24 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:25 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.450s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:25 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:23:25 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Deleted volume successfully.
Sep 29 18:23:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e7b38d52-622b-409d-b95f-0df088fb4644 tempest-VolumesListTestJSON-2121287079 None] Lock "cinder-95349981-bbbd-4057-aeca-70ca1819fd2d-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "cinder-719f006c-012a-4330-9911-407ea901d332-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-719f006c-012a-4330-9911-407ea901d332-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "cinder-quobyte-719f006c-012a-4330-9911-407ea901d332" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-quobyte-719f006c-012a-4330-9911-407ea901d332" acquired by "delete_volume" :: waited 0.030s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:33 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d10934-8353-41a1-9ba4-c87f6a373391]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:23:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:33 devstack sudo[97476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332
Sep 29 18:23:33 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:33 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332" returned: 0 in 0.802s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:33 devstack sudo[97494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332
Sep 29 18:23:33 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:34 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-719f006c-012a-4330-9911-407ea901d332" returned: 0 in 0.527s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-quobyte-719f006c-012a-4330-9911-407ea901d332" released by "delete_volume" :: held 1.435s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:34 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Created reservations ['6adfd240-084b-4c4d-bd4c-4c72b52fdea4', '7a5e63a0-beb3-48a3-abe0-02e0d77b0a1b', 'eba90b9b-5a65-42cb-b00a-d29771c4ec78', '9a462b26-2178-496d-ae29-1c53b7114170'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:23:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:34 devstack sudo[97504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:23:34 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:34 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.331s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:34 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:23:34 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Deleted volume successfully.
Sep 29 18:23:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8a6b90ba-cbf4-43df-a72a-0ef2a3e84cf7 tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-719f006c-012a-4330-9911-407ea901d332-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "cinder-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "cinder-quobyte-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-quobyte-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:35 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc368464-3f96-4f2d-ae25-9c39b9b9e702]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:23:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:35 devstack sudo[97507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f
Sep 29 18:23:35 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:36 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f" returned: 0 in 0.516s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:36 devstack sudo[97512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f
Sep 29 18:23:36 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:36 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f" returned: 0 in 0.675s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-quobyte-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f" released by "delete_volume" :: held 1.266s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=68,cinder:UPDATE=76,cinder:DELETE=7,cinder:INSERT=21 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=83,cinder:SELECT=71,cinder:INSERT=25,cinder:DELETE=7 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Created reservations ['6aae9350-b576-43e1-a7b1-24c4fe1b11c7', '8d925d34-0d08-43e4-b19d-9f47bb7d4eef', '16e309e4-ddab-4127-9936-71353f261a55', '5a9045e7-348e-4e48-8abf-c3260b2a219f'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:37 devstack sudo[97516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:23:37 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:37 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.355s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:37 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:23:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Deleted volume successfully.
Sep 29 18:23:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ca04d7ff-b192-4c15-98f4-dfbbc2887a1c tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-1733e5e9-6662-4e1c-8a5e-ac62a64cad7f-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "cinder-f347b04b-1dcb-453f-aaa0-247e87f1ea08-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-f347b04b-1dcb-453f-aaa0-247e87f1ea08-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "cinder-quobyte-f347b04b-1dcb-453f-aaa0-247e87f1ea08" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-quobyte-f347b04b-1dcb-453f-aaa0-247e87f1ea08" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:38 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[31efcb09-d0d0-4c3b-9067-08fdfcfcd075]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:23:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:38 devstack sudo[97595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08
Sep 29 18:23:38 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:39 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08" returned: 0 in 0.630s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:39 devstack sudo[97615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08
Sep 29 18:23:39 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:39 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f347b04b-1dcb-453f-aaa0-247e87f1ea08" returned: 0 in 0.348s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-quobyte-f347b04b-1dcb-453f-aaa0-247e87f1ea08" released by "delete_volume" :: held 1.105s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:39 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Created reservations ['ccb317c1-457f-4531-9d8c-8d783b7b2750', 'fd9bfbd5-123d-488f-a771-e76bbc49c949', '2b8da2ad-31ec-4fdb-b47b-3a2cd13b8d2e', '5da56eb3-bd7c-45b7-84f7-2674e717c41c'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:23:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:39 devstack sudo[97634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:23:39 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:40 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.444s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:40 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:23:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Deleted volume successfully.
Sep 29 18:23:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8287d79c-5967-4372-8bdd-2a381ed3e9ed tempest-AttachVolumeNegativeTest-103688396 None] Lock "cinder-f347b04b-1dcb-453f-aaa0-247e87f1ea08-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c1376b11-f35b-4b6e-beaa-22bcc8718f76 tempest-VolumesActionsTest-80614654 None] Acquiring lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173" by "attach_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c1376b11-f35b-4b6e-beaa-22bcc8718f76 tempest-VolumesActionsTest-80614654 None] Lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173" acquired by "attach_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c1376b11-f35b-4b6e-beaa-22bcc8718f76 tempest-VolumesActionsTest-80614654 None] Attaching volume 5cdacab6-d30c-4b20-9d98-5c1e30272173 to instance 240eb809-f954-441c-a394-77c0dbaa109f at mountpoint /dev/vdb on host None.
Sep 29 18:23:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c1376b11-f35b-4b6e-beaa-22bcc8718f76 tempest-VolumesActionsTest-80614654 None] Attach volume completed successfully.
Sep 29 18:23:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c1376b11-f35b-4b6e-beaa-22bcc8718f76 tempest-VolumesActionsTest-80614654 None] Lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173" released by "attach_volume" :: held 0.158s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8e7f2200-76eb-4655-b861-e8c2aa0d3341 tempest-VolumesActionsTest-80614654 None] Acquiring lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173-detach_volume" by "detach_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:23:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8e7f2200-76eb-4655-b861-e8c2aa0d3341 tempest-VolumesActionsTest-80614654 None] Lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:23:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8e7f2200-76eb-4655-b861-e8c2aa0d3341 tempest-VolumesActionsTest-80614654 None] Detaching volume 5cdacab6-d30c-4b20-9d98-5c1e30272173 from instance 240eb809-f954-441c-a394-77c0dbaa109f.
Sep 29 18:23:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8e7f2200-76eb-4655-b861-e8c2aa0d3341 tempest-VolumesActionsTest-80614654 None] Detach volume completed successfully.
Sep 29 18:23:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8e7f2200-76eb-4655-b861-e8c2aa0d3341 tempest-VolumesActionsTest-80614654 None] Lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Flow 'volume_create_manager' (484becae-222d-4c15-b5da-4c5a8144123c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49df3d3-b207-4e94-a8a0-96f0e2f537d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49df3d3-b207-4e94-a8a0-96f0e2f537d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-669523862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b701974-2038-4b3d-bc35-c07770afe2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5fe79a4d404ea29e7aaac7685dc50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:50Z,use_quota=True,user_id='064b23db58a344c587e0498e45056857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae33bfa2-e0b1-41b1-9ba3-d66ac9c2c652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae33bfa2-e0b1-41b1-9ba3-d66ac9c2c652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1df313b-8adb-4791-ae67-58882f8dbb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1df313b-8adb-4791-ae67-58882f8dbb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b701974-2038-4b3d-bc35-c07770afe2bd', 'volume_name': 'volume-0b701974-2038-4b3d-bc35-c07770afe2bd', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facdbba2-151b-491d-830b-cfa1cabb72e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facdbba2-151b-491d-830b-cfa1cabb72e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35446249-ca46-485b-8aea-3d1e629ca066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:50 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Volume 0b701974-2038-4b3d-bc35-c07770afe2bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b701974-2038-4b3d-bc35-c07770afe2bd', 'volume_size': 1}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-669523862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b701974-2038-4b3d-bc35-c07770afe2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5fe79a4d404ea29e7aaac7685dc50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:50Z,use_quota=True,user_id='064b23db58a344c587e0498e45056857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Creating volume 0b701974-2038-4b3d-bc35-c07770afe2bd {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:23:50 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:23:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:50 devstack sudo[97671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd 1073741824
Sep 29 18:23:50 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:51 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd 1073741824" returned: 0 in 0.709s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:51 devstack sudo[97677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd
Sep 29 18:23:51 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:51 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd" returned: 0 in 0.344s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:23:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35446249-ca46-485b-8aea-3d1e629ca066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b701974-2038-4b3d-bc35-c07770afe2bd', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155e29cd-8821-4ba6-bd8b-7c454750e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:51 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Volume volume-0b701974-2038-4b3d-bc35-c07770afe2bd (0b701974-2038-4b3d-bc35-c07770afe2bd): created successfully
Sep 29 18:23:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155e29cd-8821-4ba6-bd8b-7c454750e827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Flow 'volume_create_manager' (484becae-222d-4c15-b5da-4c5a8144123c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:51 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-11922c60-f3b3-4dce-baea-d49439dd5955 tempest-AttachVolumeTestJSON-623007192 None] Created volume successfully.
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Flow 'volume_create_manager' (634cda3a-79b2-4e5d-809c-6be81d9cd8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110b30a7-047f-46bd-881c-2f1dad9d438d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df56a6ff-1772-4d3a-a1ba-98ce3fd5d8a1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110b30a7-047f-46bd-881c-2f1dad9d438d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1243535869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5aa844b-3611-4ce8-888c-7318fd51066c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52d07671a671486ca91f3d3a8442292a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:53Z,use_quota=True,user_id='4ab6ebe0c98242c1b8208916e8e8a3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e024a81d-775d-45d7-bea4-31666f9156a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e024a81d-775d-45d7-bea4-31666f9156a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe68291b-8a45-46b8-b0f1-59599269f307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe68291b-8a45-46b8-b0f1-59599269f307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5aa844b-3611-4ce8-888c-7318fd51066c', 'volume_name': 'volume-c5aa844b-3611-4ce8-888c-7318fd51066c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1ce603-e1c2-4761-8f68-2add32713083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1ce603-e1c2-4761-8f68-2add32713083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde89a84-c783-43ae-9086-cf1adae3d9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:23:52 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Volume c5aa844b-3611-4ce8-888c-7318fd51066c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5aa844b-3611-4ce8-888c-7318fd51066c', 'volume_size': 1}
Sep 29 18:23:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:53 devstack sudo[97684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173
Sep 29 18:23:53 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:53 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173" returned: 0 in 0.497s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:53 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d98f2cf-6fac-4070-9abd-cff6d7a1366a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:23:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-519b0d0d-dbb6-456e-a0b5-d8c9ba837d8b req-508bac3c-17b0-4933-987d-fe82bc209492 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:53 devstack sudo[97699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173
Sep 29 18:23:53 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:53 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173" returned: 0 in 0.435s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.1cdbbf8a-1528-4556-810d-57aee33021e8xq7bwwp0.img {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:53 devstack sudo[97704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.1cdbbf8a-1528-4556-810d-57aee33021e8xq7bwwp0.img
Sep 29 18:23:53 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:23:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:23:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:23:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:23:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:23:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:23:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:23:54 devstack sudo[97716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:23:54 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:23:54 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root
Sep 29 18:23:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.568s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:23:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:23:55 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:23:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:23:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:24:01 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.1cdbbf8a-1528-4556-810d-57aee33021e8xq7bwwp0.img" returned: 0 in 7.411s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:01 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dda1d44-b154-4117-813e-1aeec70d3dca]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:01 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173
Sep 29 18:24:01 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:01 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173" returned: 0 in 0.552s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:01 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.1cdbbf8a-1528-4556-810d-57aee33021e8xq7bwwp0.img {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:24:01 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] Converted 1024.00 MB image at 138.15 MB/s
Sep 29 18:24:01 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] 1cdbbf8a-1528-4556-810d-57aee33021e8 was raw, no need to convert to raw {{(pid=86821) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Flow 'volume_create_manager' (381ae3d7-acea-4d4a-864e-63797e4fc8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ddf0e0-a26e-4f45-9f60-ac1655c3b001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ddf0e0-a26e-4f45-9f60-ac1655c3b001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-204893529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea1d6e9-de2f-447f-a525-77e08fada5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080652192fc442e5a6283f5699573bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:21Z,use_quota=True,user_id='91c724f8bffb402da9d88671005d78ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8ea122-bdf9-48f8-8043-c7cf761da9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8ea122-bdf9-48f8-8043-c7cf761da9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5be0a40-0def-4acf-8e58-99ce868f6139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5be0a40-0def-4acf-8e58-99ce868f6139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea1d6e9-de2f-447f-a525-77e08fada5fc', 'volume_name': 'volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24f234b-ac9f-4983-8b37-44cb61706c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24f234b-ac9f-4983-8b37-44cb61706c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41d6a5c-7087-48b5-a138-e7aaec1c9547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:20 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Volume 0ea1d6e9-de2f-447f-a525-77e08fada5fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc', 'volume_size': 1}
Sep 29 18:24:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.416s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] Uploaded volume to glance image-id: 1cdbbf8a-1528-4556-810d-57aee33021e8. {{(pid=86821) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 33.281s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1243535869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5aa844b-3611-4ce8-888c-7318fd51066c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='52d07671a671486ca91f3d3a8442292a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:53Z,use_quota=True,user_id='4ab6ebe0c98242c1b8208916e8e8a3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Creating volume c5aa844b-3611-4ce8-888c-7318fd51066c {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:24:26 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:26 devstack sudo[97901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c 1073741824
Sep 29 18:24:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8619b7e9-62f5-46a1-b889-df88c43eed77 tempest-VolumesActionsTest-80614654 None] Copy volume to image completed successfully.
Sep 29 18:24:26 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:26 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c 1073741824" returned: 0 in 0.430s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:26 devstack sudo[97907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c
Sep 29 18:24:26 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:26 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c" returned: 0 in 0.243s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-519b0d0d-dbb6-456e-a0b5-d8c9ba837d8b req-508bac3c-17b0-4933-987d-fe82bc209492 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 33.494s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde89a84-c783-43ae-9086-cf1adae3d9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5aa844b-3611-4ce8-888c-7318fd51066c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74fe422-5161-46c5-bf1d-89ccd7484a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-519b0d0d-dbb6-456e-a0b5-d8c9ba837d8b req-508bac3c-17b0-4933-987d-fe82bc209492 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.259s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-204893529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea1d6e9-de2f-447f-a525-77e08fada5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080652192fc442e5a6283f5699573bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:21Z,use_quota=True,user_id='91c724f8bffb402da9d88671005d78ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Creating volume 0ea1d6e9-de2f-447f-a525-77e08fada5fc {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:24:27 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:27 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Volume volume-c5aa844b-3611-4ce8-888c-7318fd51066c (c5aa844b-3611-4ce8-888c-7318fd51066c): created successfully
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74fe422-5161-46c5-bf1d-89ccd7484a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:27 devstack sudo[97910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc 1073741824
Sep 29 18:24:27 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Flow 'volume_create_manager' (634cda3a-79b2-4e5d-809c-6be81d9cd8de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:24:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-c05363e8-324a-4c46-b8fe-d2ec00d13984 req-6a3f1f54-4ebb-4462-8afb-b5e13b6be2b4 tempest-VolumesGetTestJSON-1488620837 None] Created volume successfully.
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-519b0d0d-dbb6-456e-a0b5-d8c9ba837d8b req-508bac3c-17b0-4933-987d-fe82bc209492 tempest-AttachVolumeTestJSON-623007192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-0b701974-2038-4b3d-bc35-c07770afe2bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7f55179-ec93-44e6-b05a-60dc7d6cd625', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:24:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-519b0d0d-dbb6-456e-a0b5-d8c9ba837d8b req-508bac3c-17b0-4933-987d-fe82bc209492 tempest-AttachVolumeTestJSON-623007192 None] attachment_update completed successfully.
Sep 29 18:24:27 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc 1073741824" returned: 0 in 0.792s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:27 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc
Sep 29 18:24:27 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Acquiring lock "cinder-c5aa844b-3611-4ce8-888c-7318fd51066c-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Lock "cinder-c5aa844b-3611-4ce8-888c-7318fd51066c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Acquiring lock "cinder-quobyte-c5aa844b-3611-4ce8-888c-7318fd51066c" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:24:28 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Lock "cinder-quobyte-c5aa844b-3611-4ce8-888c-7318fd51066c" acquired by "delete_volume" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc" returned: 0 in 0.494s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41d6a5c-7087-48b5-a138-e7aaec1c9547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18756014-84da-4a6e-8442-27a367d94989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a0fe0c-35aa-435e-bf16-c1018d607faa]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:28 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Volume volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc (0ea1d6e9-de2f-447f-a525-77e08fada5fc): created successfully
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18756014-84da-4a6e-8442-27a367d94989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Flow 'volume_create_manager' (381ae3d7-acea-4d4a-864e-63797e4fc8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:24:28 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8233a7bd-037a-48e7-a4c9-b073412a5c0a tempest-TestMinimumBasicScenario-1260489814 None] Created volume successfully.
Sep 29 18:24:28 devstack sudo[98338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c
Sep 29 18:24:28 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:29 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c" returned: 0 in 0.598s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a705301c-06a1-4229-8a69-814d8c3479ac]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:29 devstack sudo[98343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c
Sep 29 18:24:29 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:29 devstack sudo[98344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173
Sep 29 18:24:29 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:29 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c5aa844b-3611-4ce8-888c-7318fd51066c" returned: 0 in 0.283s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Lock "cinder-quobyte-c5aa844b-3611-4ce8-888c-7318fd51066c" released by "delete_volume" :: held 1.008s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG cinder.quota [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Created reservations ['e9851c26-e180-4829-a436-adfe7274b91f', 'b1856cad-0cdd-4001-bedb-acb0b776d281', 'a69c39e0-d713-4d02-91cd-6dd61a34d03d', 'd73de119-549a-4f60-bdfd-9695a02ac859'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:24:29 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173" returned: 0 in 0.505s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e5db6f-9ac6-414b-9005-370d148eeaba]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:29 devstack sudo[98351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:24:29 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:29 devstack sudo[98357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173
Sep 29 18:24:29 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:30 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.631s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.manager [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:24:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Deleted volume successfully.
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-87c75ff3-6f98-4402-9cd7-88030cbd603b req-52bfb325-4e4d-401a-a426-d8716bf6639b tempest-VolumesGetTestJSON-1488620837 None] Lock "cinder-c5aa844b-3611-4ce8-888c-7318fd51066c-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:24:30 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173" returned: 0 in 0.807s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:30 devstack sudo[98378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img
Sep 29 18:24:30 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Flow 'volume_create_manager' (28d6cef1-35f4-496b-981b-39bd3aa5e453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a081bbd2-fc48-457a-83ac-239367547c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a081bbd2-fc48-457a-83ac-239367547c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-814852397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42854983-6ce8-4e89-9856-93eaefc0e10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5fe79a4d404ea29e7aaac7685dc50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:31Z,use_quota=True,user_id='064b23db58a344c587e0498e45056857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5607e9-82c6-4503-b588-a0c2d98a4548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5607e9-82c6-4503-b588-a0c2d98a4548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b98e6e-1f9b-4aa7-8217-cbccf863a0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b98e6e-1f9b-4aa7-8217-cbccf863a0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42854983-6ce8-4e89-9856-93eaefc0e10a', 'volume_name': 'volume-42854983-6ce8-4e89-9856-93eaefc0e10a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2136d8a-cc6c-4201-927a-87e92f29f3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2136d8a-cc6c-4201-927a-87e92f29f3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fe003d-df83-4b06-b41c-9a8e277b707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:30 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Volume 42854983-6ce8-4e89-9856-93eaefc0e10a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42854983-6ce8-4e89-9856-93eaefc0e10a', 'volume_size': 1}
Sep 29 18:24:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-22118663-d083-4636-9b2d-04778061cf1b req-6bb10356-1c5a-4500-a284-a3405b37c1c0 tempest-TestMinimumBasicScenario-1260489814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:37 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img" returned: 0 in 7.291s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:37 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d5e5cd-c68a-4f08-a453-c2525ca8a928]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:37 devstack sudo[98406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173
Sep 29 18:24:37 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:38 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173" returned: 0 in 0.585s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:38 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173, size 1024.00 MB, duration 7.29 sec, destination /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:24:38 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Converted 1024.00 MB image at 140.39 MB/s
Sep 29 18:24:38 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:INSERT=13,cinder:UPDATE=41,cinder:SELECT=33,cinder:DELETE=2 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:24:38 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=40,cinder:UPDATE=36,cinder:DELETE=4,cinder:INSERT=4 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:24:38 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] 9b1bab66-2906-4d1a-9a53-12bc76f335bd was raw, converting to qcow2 {{(pid=86821) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 29 18:24:38 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd6aa0-aa3a-406c-930d-37809930babb]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:38 devstack sudo[98411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img
Sep 29 18:24:38 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:38 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img" returned: 0 in 0.364s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:38 devstack sudo[98415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img
Sep 29 18:24:38 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:39 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img" returned: 1 in 0.341s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:24:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img /opt/stack/data/cinder/conversion/vol_upload_l7353th1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:39 devstack sudo[98420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img /opt/stack/data/cinder/conversion/vol_upload_l7353th1
Sep 29 18:24:39 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:39 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img /opt/stack/data/cinder/conversion/vol_upload_l7353th1" returned: 0 in 0.287s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:39 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Image conversion details: src /opt/stack/data/cinder/conversion/5cdacab6-d30c-4b20-9d98-5c1e30272173.temp_image.9b1bab66-2906-4d1a-9a53-12bc76f335bdjldn9s99.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_l7353th1 {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:24:39 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 29 18:24:39 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[791cea93-1094-4e4a-8392-3a127cf34d58]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l7353th1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:39 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l7353th1
Sep 29 18:24:39 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:39 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l7353th1" returned: 0 in 0.379s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.335s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Uploaded volume to glance image-id: 9b1bab66-2906-4d1a-9a53-12bc76f335bd. {{(pid=86821) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.468s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-814852397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42854983-6ce8-4e89-9856-93eaefc0e10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5fe79a4d404ea29e7aaac7685dc50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:31Z,use_quota=True,user_id='064b23db58a344c587e0498e45056857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Creating volume 42854983-6ce8-4e89-9856-93eaefc0e10a {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:24:41 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:41 devstack sudo[98434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a 1073741824
Sep 29 18:24:41 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:41 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6b711c3b-715f-44e7-90b2-b9ddcf180061 tempest-VolumesActionsTest-80614654 None] Copy volume to image completed successfully.
Sep 29 18:24:41 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a 1073741824" returned: 0 in 0.559s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:42 devstack sudo[98440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a
Sep 29 18:24:42 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:42 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a" returned: 0 in 0.287s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-22118663-d083-4636-9b2d-04778061cf1b req-6bb10356-1c5a-4500-a284-a3405b37c1c0 tempest-TestMinimumBasicScenario-1260489814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.209s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-22118663-d083-4636-9b2d-04778061cf1b req-6bb10356-1c5a-4500-a284-a3405b37c1c0 tempest-TestMinimumBasicScenario-1260489814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fe003d-df83-4b06-b41c-9a8e277b707a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42854983-6ce8-4e89-9856-93eaefc0e10a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb2f0c2-3fc4-4bf2-b726-9c9f0548aec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:42 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Volume volume-42854983-6ce8-4e89-9856-93eaefc0e10a (42854983-6ce8-4e89-9856-93eaefc0e10a): created successfully
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb2f0c2-3fc4-4bf2-b726-9c9f0548aec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Flow 'volume_create_manager' (28d6cef1-35f4-496b-981b-39bd3aa5e453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-22118663-d083-4636-9b2d-04778061cf1b req-6bb10356-1c5a-4500-a284-a3405b37c1c0 tempest-TestMinimumBasicScenario-1260489814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cae9abb3-ff3c-4515-b0af-d20ea0b2d78b', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:24:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d3cd0568-a38a-495a-a534-46f8bbb7e515 tempest-AttachVolumeTestJSON-623007192 None] Created volume successfully.
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Acquiring lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Acquiring lock "cinder-quobyte-5cdacab6-d30c-4b20-9d98-5c1e30272173" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:24:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-22118663-d083-4636-9b2d-04778061cf1b req-6bb10356-1c5a-4500-a284-a3405b37c1c0 tempest-TestMinimumBasicScenario-1260489814 None] attachment_update completed successfully.
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Lock "cinder-quobyte-5cdacab6-d30c-4b20-9d98-5c1e30272173" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3424163-b735-4ee4-b1c8-f97624ffd7db]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:42 devstack sudo[98443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173
Sep 29 18:24:42 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:43 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173" returned: 0 in 0.544s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:43 devstack sudo[98457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173
Sep 29 18:24:43 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:43 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5cdacab6-d30c-4b20-9d98-5c1e30272173" returned: 0 in 0.375s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Lock "cinder-quobyte-5cdacab6-d30c-4b20-9d98-5c1e30272173" released by "delete_volume" :: held 0.988s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Created reservations ['9696835a-e081-4cc0-815d-1b4046a401b0', 'c1f5637a-4723-46c4-ba0a-5a71123647b9', '8afb30b1-c237-4901-b999-0816496c159c', '1e02b060-75a4-4fba-bc4b-dae7d76fe71c'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:43 devstack sudo[98468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:24:43 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-e67bf24b-30a4-4347-8614-442136cf9a57 req-7f3c1275-395a-4030-835d-d4c0d96f701b tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-e67bf24b-30a4-4347-8614-442136cf9a57 req-7f3c1275-395a-4030-835d-d4c0d96f701b tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-e67bf24b-30a4-4347-8614-442136cf9a57 req-7f3c1275-395a-4030-835d-d4c0d96f701b tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-e67bf24b-30a4-4347-8614-442136cf9a57 req-7f3c1275-395a-4030-835d-d4c0d96f701b tempest-AttachVolumeTestJSON-623007192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-42854983-6ce8-4e89-9856-93eaefc0e10a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eac1bf75-766c-4780-82a8-58a0e56529c5', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:24:43 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-e67bf24b-30a4-4347-8614-442136cf9a57 req-7f3c1275-395a-4030-835d-d4c0d96f701b tempest-AttachVolumeTestJSON-623007192 None] attachment_update completed successfully.
Sep 29 18:24:44 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.284s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:44 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:24:44 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Deleted volume successfully.
Sep 29 18:24:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a7ca1ec1-7753-4384-a7c1-874b0ada6207 tempest-VolumesActionsTest-80614654 None] Lock "cinder-5cdacab6-d30c-4b20-9d98-5c1e30272173-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:24:44 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6913c1bb-e2c0-4d9a-9896-f6eb0bbf09d9 tempest-GroupsV320Test-707726243 None] Group tempest-GroupsV320Test-Group-1620375437: creating
Sep 29 18:24:44 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6913c1bb-e2c0-4d9a-9896-f6eb0bbf09d9 tempest-GroupsV320Test-707726243 None] Group tempest-GroupsV320Test-Group-1620375437: created successfully
Sep 29 18:24:44 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6913c1bb-e2c0-4d9a-9896-f6eb0bbf09d9 tempest-GroupsV320Test-707726243 None] Create group completed successfully.
Sep 29 18:24:46 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-c7fc0850-8e46-49b3-a034-bfd1e70a102e tempest-GroupsV320Test-707726243 None] Created reservations ['53a04853-d110-40a3-a637-54967d529bdd'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:24:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c7fc0850-8e46-49b3-a034-bfd1e70a102e tempest-GroupsV320Test-707726243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c7fc0850-8e46-49b3-a034-bfd1e70a102e tempest-GroupsV320Test-707726243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c7fc0850-8e46-49b3-a034-bfd1e70a102e tempest-GroupsV320Test-707726243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:24:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c7fc0850-8e46-49b3-a034-bfd1e70a102e tempest-GroupsV320Test-707726243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:24:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c7fc0850-8e46-49b3-a034-bfd1e70a102e tempest-GroupsV320Test-707726243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c7fc0850-8e46-49b3-a034-bfd1e70a102e tempest-GroupsV320Test-707726243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:46 devstack sudo[98479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:24:46 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:46 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c7fc0850-8e46-49b3-a034-bfd1e70a102e tempest-GroupsV320Test-707726243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.286s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:46 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-c7fc0850-8e46-49b3-a034-bfd1e70a102e tempest-GroupsV320Test-707726243 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:24:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c7fc0850-8e46-49b3-a034-bfd1e70a102e tempest-GroupsV320Test-707726243 None] Delete group completed successfully.
Sep 29 18:24:47 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-26a29ad5-9cad-4902-b310-89213a7700b8 req-89adcb40-9242-4bbf-8ec6-672f53217aa1 tempest-AttachVolumeTestJSON-623007192 None] Terminate volume connection completed successfully.
Sep 29 18:24:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-26a29ad5-9cad-4902-b310-89213a7700b8 req-89adcb40-9242-4bbf-8ec6-672f53217aa1 tempest-AttachVolumeTestJSON-623007192 None] Deleting attachment a7f55179-ec93-44e6-b05a-60dc7d6cd625. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:24:48 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-6656f776-6b89-4d2a-9347-19c894f73e0e req-f73949d0-aca8-4c9e-8dcd-9fb0842aea1e tempest-AttachVolumeTestJSON-623007192 None] Terminate volume connection completed successfully.
Sep 29 18:24:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-6656f776-6b89-4d2a-9347-19c894f73e0e req-f73949d0-aca8-4c9e-8dcd-9fb0842aea1e tempest-AttachVolumeTestJSON-623007192 None] Deleting attachment eac1bf75-766c-4780-82a8-58a0e56529c5. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:54 devstack sudo[98548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:24:54 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:54 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.565s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:24:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:24:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "cinder-42854983-6ce8-4e89-9856-93eaefc0e10a-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:24:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-42854983-6ce8-4e89-9856-93eaefc0e10a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:24:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "cinder-quobyte-42854983-6ce8-4e89-9856-93eaefc0e10a" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:24:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-quobyte-42854983-6ce8-4e89-9856-93eaefc0e10a" acquired by "delete_volume" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:24:55 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4294e70c-1ac8-4025-85cb-3e685e053a38]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:56 devstack sudo[98553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a
Sep 29 18:24:56 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:56 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a" returned: 0 in 0.499s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:56 devstack sudo[98558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a
Sep 29 18:24:56 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:56 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-42854983-6ce8-4e89-9856-93eaefc0e10a" returned: 0 in 0.339s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-quobyte-42854983-6ce8-4e89-9856-93eaefc0e10a" released by "delete_volume" :: held 0.913s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:24:56 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Created reservations ['3876a9cd-b677-4968-8a09-22f85993aed6', '309b9607-4573-471e-8321-439373fdeffe', '7c7533b9-a9a5-471b-b72a-cb22e27731a7', '76b04829-2d40-4cc5-8cf5-509c1feaa5fb'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:24:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:24:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:24:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:56 devstack sudo[98561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:24:56 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "cinder-0b701974-2038-4b3d-bc35-c07770afe2bd-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-0b701974-2038-4b3d-bc35-c07770afe2bd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "cinder-quobyte-0b701974-2038-4b3d-bc35-c07770afe2bd" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-quobyte-0b701974-2038-4b3d-bc35-c07770afe2bd" acquired by "delete_volume" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fe5b7a-5cbf-410a-ba4a-a2e2682412dc]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:57 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.351s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:24:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Deleted volume successfully.
Sep 29 18:24:57 devstack sudo[98563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd
Sep 29 18:24:57 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-340c1838-1b41-4362-9647-7f8990ca44e9 tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-42854983-6ce8-4e89-9856-93eaefc0e10a-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:24:57 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd" returned: 0 in 0.463s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:57 devstack sudo[98570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd
Sep 29 18:24:57 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:24:57 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Flow 'volume_create_manager' (959d87f7-fd60-46f0-8e5b-d90ee39aa067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0f5ce2-3c94-4b41-a24b-29367757ce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0b701974-2038-4b3d-bc35-c07770afe2bd" returned: 0 in 0.367s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0f5ce2-3c94-4b41-a24b-29367757ce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-586667304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805082bf-a14b-41bb-b779-9884dd1b1cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd226d980e44e818ed0effb52e55a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:58Z,use_quota=True,user_id='ffc9056237cd4adb8bc63c28287bc045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74945af-b448-4b71-a482-e5ba7e5fad3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74945af-b448-4b71-a482-e5ba7e5fad3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3378215-8fcb-4225-b59e-16a22c190d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.image.glance [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Creating Keystone auth plugin from conf {{(pid=86821) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-quobyte-0b701974-2038-4b3d-bc35-c07770afe2bd" released by "delete_volume" :: held 0.930s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Created reservations ['4a3e99da-9a85-42e4-945c-a274bf7429c9', '815189fa-8b68-47c4-a78f-c3d593254b14', '726dadf2-8280-42b4-bc85-9f9fb6be264b', '1f17388e-f421-4436-8c19-d9bc4f1ff20d'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:58 devstack sudo[98573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:24:58 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3378215-8fcb-4225-b59e-16a22c190d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '805082bf-a14b-41bb-b779-9884dd1b1cce', 'volume_name': 'volume-805082bf-a14b-41bb-b779-9884dd1b1cce', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c590d10>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4368d2d1-fd61-45f6-b754-1b7c1abb3240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4368d2d1-fd61-45f6-b754-1b7c1abb3240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee93f40-bf84-4d33-8a11-731458b84bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:24:58 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Volume 805082bf-a14b-41bb-b779-9884dd1b1cce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-805082bf-a14b-41bb-b779-9884dd1b1cce', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c590d10>}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Trying to clone 805082bf-a14b-41bb-b779-9884dd1b1cce from image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]). {{(pid=86821) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "cinder-a7d57835-9150-4071-be2d-5f841732ea95-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-a7d57835-9150-4071-be2d-5f841732ea95-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "cinder-quobyte-a7d57835-9150-4071-be2d-5f841732ea95" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-quobyte-a7d57835-9150-4071-be2d-5f841732ea95" acquired by "delete_volume" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:24:58 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d279fe3c-cdae-494d-9750-55f239b0eb9f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.394s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:24:58 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Deleted volume successfully.
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb4e3608-783f-4bed-83bf-7c32304a6e54 tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-0b701974-2038-4b3d-bc35-c07770afe2bd-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:24:58 devstack sudo[98576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95
Sep 29 18:24:58 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 18:24:58 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc83f60f-4287-40e3-8db1-bda153e68028]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:59 devstack sudo[98579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD
Sep 29 18:24:59 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:59 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95" returned: 0 in 0.537s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:59 devstack sudo[98584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95
Sep 29 18:24:59 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:59 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Temporary image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb is fetched for user ffc9056237cd4adb8bc63c28287bc045. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[37344d55-2d1d-469c-b251-de0a06465408]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:59 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a7d57835-9150-4071-be2d-5f841732ea95" returned: 0 in 0.338s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-quobyte-a7d57835-9150-4071-be2d-5f841732ea95" released by "delete_volume" :: held 0.975s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Created reservations ['79057900-23ed-4f65-8c1f-80b574d67d5d', '535b672f-96ff-4e74-b02b-ca22038f604e', '66e420c0-7055-4ac8-a1c8-30977fbeeaf4', '89bd8011-88a0-4c0a-ba29-59b30873e3c5'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:24:59 devstack sudo[98591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD
Sep 29 18:24:59 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:59 devstack sudo[98593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:24:59 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:24:59 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-586667304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805082bf-a14b-41bb-b779-9884dd1b1cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd226d980e44e818ed0effb52e55a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:58Z,use_quota=True,user_id='ffc9056237cd4adb8bc63c28287bc045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Creating volume 805082bf-a14b-41bb-b779-9884dd1b1cce {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:24:59 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:24:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:24:59 devstack sudo[98599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce 1073741824
Sep 29 18:24:59 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:00 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.339s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:00 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:25:00 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Deleted volume successfully.
Sep 29 18:25:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a6e548c9-7774-4ed0-8e62-374e7873d8ef tempest-AttachVolumeTestJSON-623007192 None] Lock "cinder-a7d57835-9150-4071-be2d-5f841732ea95-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:00 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce 1073741824" returned: 0 in 0.502s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:00 devstack sudo[98606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce
Sep 29 18:25:00 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:00 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce" returned: 0 in 0.312s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:25:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:00 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Attempting download of d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb ((None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}])) to volume 805082bf-a14b-41bb-b779-9884dd1b1cce. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 18:25:00 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6a01ff-8f47-41ae-884d-94027c53de8b]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_2ny6o14m {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:00 devstack sudo[98609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_2ny6o14m
Sep 29 18:25:00 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:01 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_2ny6o14m" returned: 0 in 0.396s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_2ny6o14m {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:01 devstack sudo[98613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_2ny6o14m
Sep 29 18:25:01 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:01 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_2ny6o14m" returned: 1 in 0.367s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_2ny6o14m' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:25:01 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3780fe99-16a4-4dca-b04b-065416e23450]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:01 devstack sudo[98620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD
Sep 29 18:25:01 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:02 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD" returned: 0 in 0.539s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:02 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb was qcow2, converting to qcow2 {{(pid=86821) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 18:25:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:02 devstack sudo[98626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce
Sep 29 18:25:02 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:04 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce" returned: 0 in 2.473s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:04 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_60domzerdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:25:04 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Converted 112.00 MB image at 45.26 MB/s
Sep 29 18:25:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:04 devstack sudo[98638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce 1G
Sep 29 18:25:04 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:05 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce 1G" returned: 0 in 0.368s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Downloaded image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb ((None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}])) to volume 805082bf-a14b-41bb-b779-9884dd1b1cce successfully. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Temporary image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb for user ffc9056237cd4adb8bc63c28287bc045 is deleted. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Marking volume 805082bf-a14b-41bb-b779-9884dd1b1cce as bootable. {{(pid=86821) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Copying metadata from image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb to 805082bf-a14b-41bb-b779-9884dd1b1cce. {{(pid=86821) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Creating volume glance metadata for volume 805082bf-a14b-41bb-b779-9884dd1b1cce backed by image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86821) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee93f40-bf84-4d33-8a11-731458b84bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805082bf-a14b-41bb-b779-9884dd1b1cce', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c590d10>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d561bcd6-ceec-4408-abba-c0a77983e10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:05 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Volume volume-805082bf-a14b-41bb-b779-9884dd1b1cce (805082bf-a14b-41bb-b779-9884dd1b1cce): created successfully
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d561bcd6-ceec-4408-abba-c0a77983e10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Flow 'volume_create_manager' (959d87f7-fd60-46f0-8e5b-d90ee39aa067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-006d60c0-e83c-4415-844e-69cd7da2bf5f tempest-VolumesExtendTest-2123041446 None] Created volume successfully.
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-627d8d4a-4559-49c8-abb8-05deed3be335 tempest-VolumesExtendTest-2123041446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-627d8d4a-4559-49c8-abb8-05deed3be335 tempest-VolumesExtendTest-2123041446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:06 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[272e5b19-1a9f-4904-814b-f3081cb1b8d0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-627d8d4a-4559-49c8-abb8-05deed3be335 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:06 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce
Sep 29 18:25:06 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:06 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-627d8d4a-4559-49c8-abb8-05deed3be335 tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce" returned: 0 in 0.455s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-627d8d4a-4559-49c8-abb8-05deed3be335 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce 2G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-627d8d4a-4559-49c8-abb8-05deed3be335 tempest-VolumesExtendTest-2123041446 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce 2G" returned: 0 in 0.186s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-627d8d4a-4559-49c8-abb8-05deed3be335 tempest-VolumesExtendTest-2123041446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.697s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:06 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-627d8d4a-4559-49c8-abb8-05deed3be335 tempest-VolumesExtendTest-2123041446 None] Extend volume completed successfully.
Sep 29 18:25:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Acquiring lock "cinder-805082bf-a14b-41bb-b779-9884dd1b1cce-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Lock "cinder-805082bf-a14b-41bb-b779-9884dd1b1cce-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Acquiring lock "cinder-quobyte-805082bf-a14b-41bb-b779-9884dd1b1cce" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Lock "cinder-quobyte-805082bf-a14b-41bb-b779-9884dd1b1cce" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:08 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2952ea4-585a-4e4f-a5fb-7317c9f4a6b1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:08 devstack sudo[99031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce
Sep 29 18:25:08 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:08 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce" returned: 0 in 0.588s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:08 devstack sudo[99038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce
Sep 29 18:25:08 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:09 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-805082bf-a14b-41bb-b779-9884dd1b1cce" returned: 0 in 0.439s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Lock "cinder-quobyte-805082bf-a14b-41bb-b779-9884dd1b1cce" released by "delete_volume" :: held 1.097s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Created reservations ['e0c07fb2-b95a-47ac-ab28-c5257793dc0a', '2604e06f-b49e-473c-854f-d0addb710e53', '0e7d4b2c-d671-4dda-b0de-b200ef295acd', '0b42be0d-b8c6-47db-9ef5-65ec20fa9136'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:09 devstack sudo[99041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:25:09 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:09 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.308s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:25:09 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Deleted volume successfully.
Sep 29 18:25:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ae702c49-4f60-4fa9-923f-745c4a13c9ee tempest-VolumesExtendTest-2123041446 None] Lock "cinder-805082bf-a14b-41bb-b779-9884dd1b1cce-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Flow 'volume_create_manager' (0e621037-e2d3-40f1-83c0-0b3a57571f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fa1a03-6116-4da5-91f2-7a546b351819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fa1a03-6116-4da5-91f2-7a546b351819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-447026249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a76471-4ca0-475a-8af0-d524dae3b315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd226d980e44e818ed0effb52e55a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:11Z,use_quota=True,user_id='ffc9056237cd4adb8bc63c28287bc045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1b3e51-34d9-41d1-92da-6aacf7f6c257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1b3e51-34d9-41d1-92da-6aacf7f6c257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcefdd5-2054-4ce6-b156-e17422b13306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcefdd5-2054-4ce6-b156-e17422b13306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a76471-4ca0-475a-8af0-d524dae3b315', 'volume_name': 'volume-b9a76471-4ca0-475a-8af0-d524dae3b315', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7c3811-ede2-411c-a3f9-856720201c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7c3811-ede2-411c-a3f9-856720201c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fd0649-526c-408d-9fec-c8e5ec9d6d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:11 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Volume b9a76471-4ca0-475a-8af0-d524dae3b315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a76471-4ca0-475a-8af0-d524dae3b315', 'volume_size': 1}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-447026249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a76471-4ca0-475a-8af0-d524dae3b315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd226d980e44e818ed0effb52e55a34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:11Z,use_quota=True,user_id='ffc9056237cd4adb8bc63c28287bc045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Creating volume b9a76471-4ca0-475a-8af0-d524dae3b315 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:25:11 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:25:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:11 devstack sudo[99044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315 1073741824
Sep 29 18:25:11 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:12 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315 1073741824" returned: 0 in 0.782s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:12 devstack sudo[99137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315
Sep 29 18:25:12 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:12 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315" returned: 0 in 0.389s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:25:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fd0649-526c-408d-9fec-c8e5ec9d6d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a76471-4ca0-475a-8af0-d524dae3b315', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07244d76-a0f0-4601-b54f-41df3acf94c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:12 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Volume volume-b9a76471-4ca0-475a-8af0-d524dae3b315 (b9a76471-4ca0-475a-8af0-d524dae3b315): created successfully
Sep 29 18:25:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07244d76-a0f0-4601-b54f-41df3acf94c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Flow 'volume_create_manager' (0e621037-e2d3-40f1-83c0-0b3a57571f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:12 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-4d2e1951-d900-4510-b8ca-2030f11c3b9f tempest-VolumesExtendTest-2123041446 None] Created volume successfully.
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Flow 'volume_create_manager' (62351be3-99e6-43b4-bc26-7ff106193b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b65996-0c78-4862-8f9c-6bd71305d6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b65996-0c78-4862-8f9c-6bd71305d6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-714453242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4904b98-7968-4519-aa37-1360c2e05fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b25eb6d03a4022af316c8ee9ebdf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:14Z,use_quota=True,user_id='859b33c21d0b42a2b1f52930ba6d55d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ddc353-44a2-4171-844b-46d78f2a7138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ddc353-44a2-4171-844b-46d78f2a7138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1f23f5-b15a-46b5-bee5-523588c845ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1f23f5-b15a-46b5-bee5-523588c845ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4904b98-7968-4519-aa37-1360c2e05fe7', 'volume_name': 'volume-f4904b98-7968-4519-aa37-1360c2e05fe7', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500ff367-079a-4b60-a36a-f20c255a7538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500ff367-079a-4b60-a36a-f20c255a7538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b31bdad-39c8-4a7c-a5af-eada3e097e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:13 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Volume f4904b98-7968-4519-aa37-1360c2e05fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4904b98-7968-4519-aa37-1360c2e05fe7', 'volume_size': 1}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-714453242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4904b98-7968-4519-aa37-1360c2e05fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b25eb6d03a4022af316c8ee9ebdf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:14Z,use_quota=True,user_id='859b33c21d0b42a2b1f52930ba6d55d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Creating volume f4904b98-7968-4519-aa37-1360c2e05fe7 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:25:13 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:13 devstack sudo[99149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7 1073741824
Sep 29 18:25:13 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:14 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7 1073741824" returned: 0 in 0.468s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:14 devstack sudo[99155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7
Sep 29 18:25:14 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:14 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7" returned: 0 in 0.292s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.762s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] Creating offline snapshot f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 of volume b9a76471-4ca0-475a-8af0-d524dae3b315 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b31bdad-39c8-4a7c-a5af-eada3e097e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4904b98-7968-4519-aa37-1360c2e05fe7', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b0d670-91d7-4ae5-b176-56fe492eb183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ac2126-248e-4924-9164-33b12a999164]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:14 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Volume volume-f4904b98-7968-4519-aa37-1360c2e05fe7 (f4904b98-7968-4519-aa37-1360c2e05fe7): created successfully
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b0d670-91d7-4ae5-b176-56fe492eb183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Flow 'volume_create_manager' (62351be3-99e6-43b4-bc26-7ff106193b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:14 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-9a56ab3c-5637-4afe-9404-994acc5acde3 req-9271a68f-9d91-4cf9-b22f-1a5f4e678858 tempest-VolumesSnapshotsTestJSON-1861618895 None] Created volume successfully.
Sep 29 18:25:14 devstack sudo[99158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315
Sep 29 18:25:14 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:15 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315" returned: 0 in 0.512s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:15 devstack sudo[99163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 1G
Sep 29 18:25:15 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:15 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 1G" returned: 0 in 0.509s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a76471-4ca0-475a-8af0-d524dae3b315 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:15 devstack sudo[99170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a76471-4ca0-475a-8af0-d524dae3b315 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8
Sep 29 18:25:15 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:16 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a76471-4ca0-475a-8af0-d524dae3b315 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8" returned: 0 in 0.372s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:16 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 is being set with open permissions: ugo+rw
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:16 devstack sudo[99176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8
Sep 29 18:25:16 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:16 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8" returned: 0 in 0.390s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:16 devstack sudo[99179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.info
Sep 29 18:25:16 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Flow 'volume_create_manager' (0c9b5184-5784-47a0-8cbe-1f0313969e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f545b1a7-02d6-4a0c-9160-8d5f9f541a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f545b1a7-02d6-4a0c-9160-8d5f9f541a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1964163659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9a362f-fd52-452e-82c7-4e313af8735f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad66e079d534f00a0a9ab3aa40ce091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:17Z,use_quota=True,user_id='4aefcdecf0af426cacbe887d4cf6d1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dabc2c-e41f-4cb0-b4cf-ca4690b2fa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dabc2c-e41f-4cb0-b4cf-ca4690b2fa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6584f671-a347-4458-916b-f1c8c1b0cfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6584f671-a347-4458-916b-f1c8c1b0cfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9a362f-fd52-452e-82c7-4e313af8735f', 'volume_name': 'volume-5f9a362f-fd52-452e-82c7-4e313af8735f', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4cadf6-2731-4efa-8f8c-a1ed09af0fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4cadf6-2731-4efa-8f8c-a1ed09af0fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf58dba2-20fd-42af-b1b4-5a8ae7ff7f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:16 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Volume 5f9a362f-fd52-452e-82c7-4e313af8735f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9a362f-fd52-452e-82c7-4e313af8735f', 'volume_size': 1}
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:16 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.info" returned: 0 in 0.355s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:16 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.info is being set with open permissions: ugo+rw
Sep 29 18:25:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:16 devstack sudo[99182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.info
Sep 29 18:25:16 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:17 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.info" returned: 0 in 0.253s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.419s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] Creating offline snapshot 6ba3ec79-f0a3-4269-904e-b46b8649970f of volume f4904b98-7968-4519-aa37-1360c2e05fe7 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:25:17 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-7806319d-de6f-4762-afda-c2523cd951b2 tempest-VolumesExtendTest-2123041446 None] Create snapshot completed successfully
Sep 29 18:25:17 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5fc324-262d-4e96-a1d4-27243234f408]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:17 devstack sudo[99185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7
Sep 29 18:25:17 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f724a218-6948-401a-b33c-f1590c105e59 tempest-VolumesExtendTest-2123041446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:17 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7" returned: 0 in 0.416s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:17 devstack sudo[99190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f 1G
Sep 29 18:25:17 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:18 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f 1G" returned: 0 in 0.440s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4904b98-7968-4519-aa37-1360c2e05fe7 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:18 devstack sudo[99195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4904b98-7968-4519-aa37-1360c2e05fe7 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f
Sep 29 18:25:18 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:18 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4904b98-7968-4519-aa37-1360c2e05fe7 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:18 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f is being set with open permissions: ugo+rw
Sep 29 18:25:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:18 devstack sudo[99200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f
Sep 29 18:25:18 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:18 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f" returned: 0 in 0.272s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:18 devstack sudo[99203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.info
Sep 29 18:25:18 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:18 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.info" returned: 0 in 0.262s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:18 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.info is being set with open permissions: ugo+rw
Sep 29 18:25:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:18 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.info
Sep 29 18:25:18 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:19 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.info" returned: 0 in 0.252s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.428s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1964163659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9a362f-fd52-452e-82c7-4e313af8735f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad66e079d534f00a0a9ab3aa40ce091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:17Z,use_quota=True,user_id='4aefcdecf0af426cacbe887d4cf6d1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Creating volume 5f9a362f-fd52-452e-82c7-4e313af8735f {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:25:19 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:19 devstack sudo[99209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f 1073741824
Sep 29 18:25:19 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:19 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-14a67b6b-cfb7-4bcd-a5f9-503fecb4ec54 req-baa3f85f-2cc0-4316-878f-4c97f39d5208 tempest-VolumesSnapshotsTestJSON-1861618895 None] Create snapshot completed successfully
Sep 29 18:25:19 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f 1073741824" returned: 0 in 0.478s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:19 devstack sudo[99214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f
Sep 29 18:25:19 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:20 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f" returned: 0 in 0.282s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f724a218-6948-401a-b33c-f1590c105e59 tempest-VolumesExtendTest-2123041446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.634s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf58dba2-20fd-42af-b1b4-5a8ae7ff7f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9a362f-fd52-452e-82c7-4e313af8735f', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2261bd1-e593-4dc2-b501-4a8e8d361bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e3045a-7a63-4ee8-b4e8-2a81c8204b87]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f724a218-6948-401a-b33c-f1590c105e59 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:20 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Volume volume-5f9a362f-fd52-452e-82c7-4e313af8735f (5f9a362f-fd52-452e-82c7-4e313af8735f): created successfully
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2261bd1-e593-4dc2-b501-4a8e8d361bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Flow 'volume_create_manager' (0c9b5184-5784-47a0-8cbe-1f0313969e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:20 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-aa0c5f0b-8100-4daf-b810-4a92a8532a8d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Created volume successfully.
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Acquiring lock "cinder-6ba3ec79-f0a3-4269-904e-b46b8649970f-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "cinder-6ba3ec79-f0a3-4269-904e-b46b8649970f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Acquiring lock "cinder-quobyte-f4904b98-7968-4519-aa37-1360c2e05fe7" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:20 devstack sudo[99217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315
Sep 29 18:25:20 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "cinder-quobyte-f4904b98-7968-4519-aa37-1360c2e05fe7" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Acquiring lock "cinder-quobyte-6ba3ec79-f0a3-4269-904e-b46b8649970f" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "cinder-quobyte-6ba3ec79-f0a3-4269-904e-b46b8649970f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Deleting offline snapshot 6ba3ec79-f0a3-4269-904e-b46b8649970f of volume f4904b98-7968-4519-aa37-1360c2e05fe7 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] snapshot_file for this snap is: volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[535abd38-32f0-47c9-89e1-bd4367d9e018]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:20 devstack sudo[99219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f
Sep 29 18:25:20 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:20 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f724a218-6948-401a-b33c-f1590c105e59 tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315" returned: 0 in 0.470s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f724a218-6948-401a-b33c-f1590c105e59 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 2G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f724a218-6948-401a-b33c-f1590c105e59 tempest-VolumesExtendTest-2123041446 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 2G" returned: 0 in 0.274s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f724a218-6948-401a-b33c-f1590c105e59 tempest-VolumesExtendTest-2123041446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.805s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:20 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f" returned: 0 in 0.516s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4904b98-7968-4519-aa37-1360c2e05fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecc09d1-7a91-48b9-81da-c293b5ed3f47]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:20 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f724a218-6948-401a-b33c-f1590c105e59 tempest-VolumesExtendTest-2123041446 None] Extend volume completed successfully.
Sep 29 18:25:21 devstack sudo[99237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7
Sep 29 18:25:21 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Creating offline snapshot 81497a45-17cb-4198-a1d4-e4727ec0d2bd of volume 5f9a362f-fd52-452e-82c7-4e313af8735f {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[354e16dc-d61b-48d4-8516-f5bcf13dd408]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:21 devstack sudo[99240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f
Sep 29 18:25:21 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:21 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7" returned: 0 in 0.514s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:21 devstack sudo[99245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f
Sep 29 18:25:21 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:21 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f" returned: 0 in 0.491s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:21 devstack sudo[99250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd 1G
Sep 29 18:25:21 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:21 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f" returned: 0 in 0.436s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:21 devstack sudo[99255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f
Sep 29 18:25:21 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Acquiring lock "cinder-f1b95a03-e8e3-4a40-bb88-4b497f88c6d8-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Lock "cinder-f1b95a03-e8e3-4a40-bb88-4b497f88c6d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Acquiring lock "cinder-quobyte-b9a76471-4ca0-475a-8af0-d524dae3b315" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Lock "cinder-quobyte-b9a76471-4ca0-475a-8af0-d524dae3b315" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Acquiring lock "cinder-quobyte-f1b95a03-e8e3-4a40-bb88-4b497f88c6d8" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Lock "cinder-quobyte-f1b95a03-e8e3-4a40-bb88-4b497f88c6d8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Deleting offline snapshot f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 of volume b9a76471-4ca0-475a-8af0-d524dae3b315 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] snapshot_file for this snap is: volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[908fbe28-efca-4fa9-acd6-dbb4ffffcdaf]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:22 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7.6ba3ec79-f0a3-4269-904e-b46b8649970f" returned: 0 in 0.301s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:22 devstack sudo[99260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8
Sep 29 18:25:22 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:22 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd 1G" returned: 0 in 0.539s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9a362f-fd52-452e-82c7-4e313af8735f -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "cinder-quobyte-6ba3ec79-f0a3-4269-904e-b46b8649970f" released by "_delete_snapshot" :: held 1.939s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "cinder-quobyte-f4904b98-7968-4519-aa37-1360c2e05fe7" released by "delete_snapshot" :: held 1.974s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:22 devstack sudo[99264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9a362f-fd52-452e-82c7-4e313af8735f -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd
Sep 29 18:25:22 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.quota [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Created reservations ['ff4841ec-05b1-41bb-924a-12e81f471a52', '0e53ffd1-e665-497a-835b-742d800e4f1f', '21eb413d-8be3-46eb-8013-b096f3fb186d', '51783b56-dcb3-401b-afa5-304dc780d4f0'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:22 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Delete snapshot completed successfully.
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-47449f9f-945e-4e4c-816d-f1808b878f4a req-1fb7bf30-9eb9-4cf2-ba37-b8ffd2fb4996 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "cinder-6ba3ec79-f0a3-4269-904e-b46b8649970f-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:22 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8" returned: 0 in 0.426s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a76471-4ca0-475a-8af0-d524dae3b315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9953ef50-9b5d-4692-9776-c536ccd61c97]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Acquiring lock "cinder-f4904b98-7968-4519-aa37-1360c2e05fe7-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "cinder-f4904b98-7968-4519-aa37-1360c2e05fe7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:22 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Acquiring lock "cinder-quobyte-f4904b98-7968-4519-aa37-1360c2e05fe7" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9a362f-fd52-452e-82c7-4e313af8735f -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd" returned: 0 in 0.399s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:22 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd is being set with open permissions: ugo+rw
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:22 devstack sudo[99271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315
Sep 29 18:25:22 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "cinder-quobyte-f4904b98-7968-4519-aa37-1360c2e05fe7" acquired by "delete_volume" :: waited 0.039s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:22 devstack sudo[99274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd
Sep 29 18:25:22 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d12069-b9bc-4b43-ab0f-62789fbbcb55]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:22 devstack sudo[99277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7
Sep 29 18:25:22 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:22 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd" returned: 0 in 0.277s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:22 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315" returned: 0 in 0.404s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:22 devstack sudo[99283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8
Sep 29 18:25:22 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:23 devstack sudo[99285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.info
Sep 29 18:25:23 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:23 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7" returned: 0 in 0.451s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:23 devstack sudo[99291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7
Sep 29 18:25:23 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:23 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.info" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:23 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.info is being set with open permissions: ugo+rw
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:23 devstack sudo[99296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.info
Sep 29 18:25:23 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:23 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8" returned: 0 in 0.451s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:23 devstack sudo[99314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8
Sep 29 18:25:23 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:23 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f4904b98-7968-4519-aa37-1360c2e05fe7" returned: 0 in 0.303s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "cinder-quobyte-f4904b98-7968-4519-aa37-1360c2e05fe7" released by "delete_volume" :: held 0.838s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:23 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG cinder.quota [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Created reservations ['ce64d60d-110f-4eb4-b206-e7c5d37253ff', 'b45ad02e-4373-4004-933e-dcb384f33ad4', '1df4ee36-75e9-45a0-a3b9-0fe5b11de84e', '9452dde5-f26a-451c-b3eb-fe3019f9034b'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.info" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:23 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-11d4230c-c2d7-49c6-b2a6-f7dda233377e tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Create snapshot completed successfully
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:23 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:23 devstack sudo[99341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:25:23 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315.f1b95a03-e8e3-4a40-bb88-4b497f88c6d8" returned: 0 in 0.363s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Lock "cinder-quobyte-f1b95a03-e8e3-4a40-bb88-4b497f88c6d8" released by "_delete_snapshot" :: held 1.812s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Lock "cinder-quobyte-b9a76471-4ca0-475a-8af0-d524dae3b315" released by "delete_snapshot" :: held 1.847s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:23 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Created reservations ['6b0d6d65-5ccf-4492-83bc-63d7ac6994f5', '1710d6ad-8f36-433b-a476-bd61a1ee0952', '8f5ddbe5-b9dd-44cf-a624-319759b6e524', '1174cc22-5e49-47a1-93ab-e10abf408774'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Delete snapshot completed successfully.
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2510ab70-601f-4e6c-a15b-238cd7ee5f4a tempest-VolumesExtendTest-2123041446 None] Lock "cinder-f1b95a03-e8e3-4a40-bb88-4b497f88c6d8-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:24 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.354s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.manager [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:25:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Deleted volume successfully.
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-c89267f2-c901-448d-b12f-560a199a1c6b req-68e5625c-0ea6-4eb0-8e76-34c6b7fde237 tempest-VolumesSnapshotsTestJSON-1861618895 None] Lock "cinder-f4904b98-7968-4519-aa37-1360c2e05fe7-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Acquiring lock "cinder-b9a76471-4ca0-475a-8af0-d524dae3b315-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Lock "cinder-b9a76471-4ca0-475a-8af0-d524dae3b315-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Acquiring lock "cinder-quobyte-b9a76471-4ca0-475a-8af0-d524dae3b315" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Lock "cinder-quobyte-b9a76471-4ca0-475a-8af0-d524dae3b315" acquired by "delete_volume" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[908e0972-d490-440a-9f91-5993badd0dbb]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:24 devstack sudo[99344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315
Sep 29 18:25:24 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:24 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315" returned: 0 in 0.427s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:24 devstack sudo[99349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315
Sep 29 18:25:24 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Acquiring lock "cinder-81497a45-17cb-4198-a1d4-e4727ec0d2bd-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "cinder-81497a45-17cb-4198-a1d4-e4727ec0d2bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Acquiring lock "cinder-quobyte-5f9a362f-fd52-452e-82c7-4e313af8735f" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "cinder-quobyte-5f9a362f-fd52-452e-82c7-4e313af8735f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Acquiring lock "cinder-quobyte-81497a45-17cb-4198-a1d4-e4727ec0d2bd" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "cinder-quobyte-81497a45-17cb-4198-a1d4-e4727ec0d2bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Deleting offline snapshot 81497a45-17cb-4198-a1d4-e4727ec0d2bd of volume 5f9a362f-fd52-452e-82c7-4e313af8735f {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] snapshot_file for this snap is: volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[de24d5c0-783a-460b-bc1c-799528ca4ba0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:25 devstack sudo[99351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd
Sep 29 18:25:25 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:25 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b9a76471-4ca0-475a-8af0-d524dae3b315" returned: 0 in 0.325s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Lock "cinder-quobyte-b9a76471-4ca0-475a-8af0-d524dae3b315" released by "delete_volume" :: held 0.829s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Created reservations ['f12acfe0-3687-4414-a3eb-b868de90ad4f', 'd0038355-2ffa-45b8-b284-c14d20ba9c9b', '8cfc3b0d-252e-4b03-8391-6c4ddbfccb95', '9fc1e2b2-a0e3-43cc-a008-3a57f887bb67'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:25 devstack sudo[99356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:25:25 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:25 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd" returned: 0 in 0.470s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f9a362f-fd52-452e-82c7-4e313af8735f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04e3580-e221-4455-a564-edffe1e07452]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:25 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.288s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:25:25 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Deleted volume successfully.
Sep 29 18:25:25 devstack sudo[99360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f
Sep 29 18:25:25 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e19489b9-4fbf-49d4-b378-665ffac564e2 tempest-VolumesExtendTest-2123041446 None] Lock "cinder-b9a76471-4ca0-475a-8af0-d524dae3b315-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:25 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f" returned: 0 in 0.489s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:25 devstack sudo[99366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd
Sep 29 18:25:25 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:26 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd" returned: 0 in 0.409s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:26 devstack sudo[99371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd
Sep 29 18:25:26 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:26 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f.81497a45-17cb-4198-a1d4-e4727ec0d2bd" returned: 0 in 0.289s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "cinder-quobyte-81497a45-17cb-4198-a1d4-e4727ec0d2bd" released by "_delete_snapshot" :: held 1.817s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "cinder-quobyte-5f9a362f-fd52-452e-82c7-4e313af8735f" released by "delete_snapshot" :: held 1.847s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:26 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Created reservations ['497c8eac-a2c8-4cb9-bd85-bbe6596b72c4', '802551ab-82ea-490a-8b54-7053c876ec2c', '44666154-cba4-4bb9-99c2-ef3ab0f1be85', 'fb781ab5-b387-449a-803d-604149a928f6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Delete snapshot completed successfully.
Sep 29 18:25:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1b96894-4199-46e5-825e-ca25723eb13d tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "cinder-81497a45-17cb-4198-a1d4-e4727ec0d2bd-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Acquiring lock "cinder-5f9a362f-fd52-452e-82c7-4e313af8735f-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "cinder-5f9a362f-fd52-452e-82c7-4e313af8735f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Acquiring lock "cinder-quobyte-5f9a362f-fd52-452e-82c7-4e313af8735f" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "cinder-quobyte-5f9a362f-fd52-452e-82c7-4e313af8735f" acquired by "delete_volume" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:27 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58f5f36-a39e-4f9f-ba5c-2aa2a3089297]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:27 devstack sudo[99374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f
Sep 29 18:25:27 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:27 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f" returned: 0 in 0.496s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:27 devstack sudo[99379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f
Sep 29 18:25:27 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:28 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5f9a362f-fd52-452e-82c7-4e313af8735f" returned: 0 in 0.383s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "cinder-quobyte-5f9a362f-fd52-452e-82c7-4e313af8735f" released by "delete_volume" :: held 1.018s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Created reservations ['48268ca6-a666-4593-b0a6-ad08af27b6e5', 'ec369193-9003-48c3-8162-24804bb5a015', '2764c0e0-4ee2-4b61-81a0-d55887b92f61', '87d6c7a4-2a82-4095-8799-d9e49f1e5d94'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:28 devstack sudo[99382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:25:28 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:28 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.350s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:25:28 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Deleted volume successfully.
Sep 29 18:25:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9aef347f-8e2c-4df3-ae40-e191bf53e628 tempest-VolumeSnapshotQuotasNegativeTestJSON-952599543 None] Lock "cinder-5f9a362f-fd52-452e-82c7-4e313af8735f-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f8d7610e-4f0e-47f0-aea3-1bcb24454929 tempest-GroupsTest-851826050 None] Group tempest-Group1-1873699637: creating
Sep 29 18:25:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f8d7610e-4f0e-47f0-aea3-1bcb24454929 tempest-GroupsTest-851826050 None] Group tempest-Group1-1873699637: created successfully
Sep 29 18:25:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f8d7610e-4f0e-47f0-aea3-1bcb24454929 tempest-GroupsTest-851826050 None] Create group completed successfully.
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Flow 'volume_create_manager' (6a9ab34c-d7bc-4a71-a416-625e75a5e43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d683f6e3-77a3-4472-b94a-4f67ba7dca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d683f6e3-77a3-4472-b94a-4f67ba7dca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-830301501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7d5b7a-abed-4eb3-be55-9252388cc18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cf4f15699b4c09aa57ef4c2ce68d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:30Z,use_quota=True,user_id='9f6a3959b0624601b0f911c28722a124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48487c20-3640-4702-b3e5-fc00317506f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48487c20-3640-4702-b3e5-fc00317506f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66940853-18dd-43c2-bedc-99f00d3b19b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66940853-18dd-43c2-bedc-99f00d3b19b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7d5b7a-abed-4eb3-be55-9252388cc18d', 'volume_name': 'volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c178400f-5b04-47c0-b3bc-a7a93f79d919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c178400f-5b04-47c0-b3bc-a7a93f79d919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd70c695-b9dc-488d-8a4c-80163129dad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:30 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Volume 0e7d5b7a-abed-4eb3-be55-9252388cc18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d', 'volume_size': 1}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-830301501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7d5b7a-abed-4eb3-be55-9252388cc18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cf4f15699b4c09aa57ef4c2ce68d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:30Z,use_quota=True,user_id='9f6a3959b0624601b0f911c28722a124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Creating volume 0e7d5b7a-abed-4eb3-be55-9252388cc18d {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:25:30 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:25:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:30 devstack sudo[99389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d 1073741824
Sep 29 18:25:30 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:31 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d 1073741824" returned: 0 in 0.613s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:31 devstack sudo[99402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d
Sep 29 18:25:31 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2f76e27d-12ff-4540-9fc3-f1038d859edc tempest-GroupsTest-851826050 None] Group tempest-Group2-961865039: creating
Sep 29 18:25:31 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d" returned: 0 in 0.429s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:25:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2f76e27d-12ff-4540-9fc3-f1038d859edc tempest-GroupsTest-851826050 None] Group tempest-Group2-961865039: created successfully
Sep 29 18:25:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd70c695-b9dc-488d-8a4c-80163129dad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f132da-8771-4216-94a8-72f83ce38e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2f76e27d-12ff-4540-9fc3-f1038d859edc tempest-GroupsTest-851826050 None] Create group completed successfully.
Sep 29 18:25:31 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Volume volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d (0e7d5b7a-abed-4eb3-be55-9252388cc18d): created successfully
Sep 29 18:25:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f132da-8771-4216-94a8-72f83ce38e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Flow 'volume_create_manager' (6a9ab34c-d7bc-4a71-a416-625e75a5e43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ad2698f7-27b4-4387-b48f-bd2b8814eb88 tempest-VolumesNegativeTest-1820965346 None] Created volume successfully.
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Flow 'volume_create_manager' (21d20b46-d57b-4499-969d-18870ed3fde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8439ffd-0501-47e4-9aae-732b2383ae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8439ffd-0501-47e4-9aae-732b2383ae5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-652422440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=584383f6-0267-4270-aa75-394ae1d48d98,host='devstack@QuobyteHD#QuobyteHD',id=65c7d995-7271-4d10-9518-39801037bf12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b87bd2a051d4362acbcd9028ad78c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:33Z,use_quota=True,user_id='42231b59a108487b878052bcf3e43ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(481f8514-c8be-4679-a5f0-ede4783d3cbb),volume_type_id=481f8514-c8be-4679-a5f0-ede4783d3cbb)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9c9746-ed34-4638-899e-e6817bcf8f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9c9746-ed34-4638-899e-e6817bcf8f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8fefa6-53f4-4fc1-b24a-2ae6d0130211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8fefa6-53f4-4fc1-b24a-2ae6d0130211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c7d995-7271-4d10-9518-39801037bf12', 'volume_name': 'volume-65c7d995-7271-4d10-9518-39801037bf12', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a65ae02-bbf9-4c8c-97cf-63a8e9665890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a65ae02-bbf9-4c8c-97cf-63a8e9665890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b3df7d-f986-4a08-91ce-ea0032873004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:33 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Volume 65c7d995-7271-4d10-9518-39801037bf12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c7d995-7271-4d10-9518-39801037bf12', 'volume_size': 1}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=584383f6-0267-4270-aa75-394ae1d48d98,created_at=2026-09-29T16:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-652422440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=584383f6-0267-4270-aa75-394ae1d48d98,host='devstack@QuobyteHD#QuobyteHD',id=65c7d995-7271-4d10-9518-39801037bf12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b87bd2a051d4362acbcd9028ad78c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:33Z,use_quota=True,user_id='42231b59a108487b878052bcf3e43ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(481f8514-c8be-4679-a5f0-ede4783d3cbb),volume_type_id=481f8514-c8be-4679-a5f0-ede4783d3cbb)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Creating volume 65c7d995-7271-4d10-9518-39801037bf12 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:25:33 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:33 devstack sudo[99416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12 1073741824
Sep 29 18:25:33 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:33 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-c0316993-5d8d-43c8-8e9e-b5ef74d7a5e4 req-0fc43f2c-29b5-4df6-b1dc-18a679f78d6d tempest-TestMinimumBasicScenario-1260489814 None] Terminate volume connection completed successfully.
Sep 29 18:25:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-c0316993-5d8d-43c8-8e9e-b5ef74d7a5e4 req-0fc43f2c-29b5-4df6-b1dc-18a679f78d6d tempest-TestMinimumBasicScenario-1260489814 None] Deleting attachment cae9abb3-ff3c-4515-b0af-d20ea0b2d78b. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:25:34 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12 1073741824" returned: 0 in 0.807s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:34 devstack sudo[99424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12
Sep 29 18:25:34 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:34 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12" returned: 0 in 0.395s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:25:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b3df7d-f986-4a08-91ce-ea0032873004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c7d995-7271-4d10-9518-39801037bf12', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542a5b19-0043-49de-9fc3-2ea2fa3713df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:34 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Volume volume-65c7d995-7271-4d10-9518-39801037bf12 (65c7d995-7271-4d10-9518-39801037bf12): created successfully
Sep 29 18:25:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542a5b19-0043-49de-9fc3-2ea2fa3713df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Flow 'volume_create_manager' (21d20b46-d57b-4499-969d-18870ed3fde6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:35 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bebfb490-b497-449e-8aeb-07527b02c018 tempest-GroupsTest-851826050 None] Created volume successfully.
Sep 29 18:25:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Acquiring lock "cinder-0ea1d6e9-de2f-447f-a525-77e08fada5fc-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Lock "cinder-0ea1d6e9-de2f-447f-a525-77e08fada5fc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Acquiring lock "cinder-quobyte-0ea1d6e9-de2f-447f-a525-77e08fada5fc" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Lock "cinder-quobyte-0ea1d6e9-de2f-447f-a525-77e08fada5fc" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:35 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36d24ea-02c1-41da-9927-e6de0a3d5f06]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:35 devstack sudo[99427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc
Sep 29 18:25:35 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:36 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc" returned: 0 in 0.505s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:36 devstack sudo[99436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc
Sep 29 18:25:36 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:36 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0ea1d6e9-de2f-447f-a525-77e08fada5fc" returned: 0 in 0.545s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Lock "cinder-quobyte-0ea1d6e9-de2f-447f-a525-77e08fada5fc" released by "delete_volume" :: held 1.119s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:36 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Created reservations ['c02c22ab-2635-47e7-b69d-f4d7fc10ab82', '5c95bcf1-2ba8-4a9d-a335-c1a421036b4a', 'f2c446d9-d895-40e4-ab4b-d0cb63dba156', 'e9af602a-3259-414e-af43-363b7b9c1727'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:37 devstack sudo[99450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:25:37 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Acquiring lock "cinder-quobyte-65c7d995-7271-4d10-9518-39801037bf12" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Lock "cinder-quobyte-65c7d995-7271-4d10-9518-39801037bf12" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75e96aa-47c0-4810-9716-efe392669d37]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:37 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.364s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:25:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Deleted volume successfully.
Sep 29 18:25:37 devstack sudo[99452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6694e6ff-e586-4264-ad6a-3450bb0a91c4 tempest-TestMinimumBasicScenario-1260489814 None] Lock "cinder-0ea1d6e9-de2f-447f-a525-77e08fada5fc-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:37 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:37 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12" returned: 0 in 0.525s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:37 devstack sudo[99458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12
Sep 29 18:25:37 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:38 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-65c7d995-7271-4d10-9518-39801037bf12" returned: 0 in 0.413s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Lock "cinder-quobyte-65c7d995-7271-4d10-9518-39801037bf12" released by "delete_volume" :: held 1.002s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Created reservations ['50cf72db-f881-4b34-9334-6f826c71f4a8'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:38 devstack cinder-volume[86821]: WARNING cinder.quota [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2032362565 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2032362565, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:25:38 devstack cinder-volume[86821]: WARNING cinder.quota [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2032362565 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2032362565, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Created reservations ['6c65c568-8452-4422-bee8-85a893a2379c', '15fa7e5e-025f-4820-98b4-4fbc002f66e7', '7cf945f4-f263-48ac-9ed5-7e415f59fb17', '9fdede1c-a29a-45ce-a8c7-16e1925af79e'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=141,cinder:SELECT=130,cinder:INSERT=38,cinder:DELETE=11 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=125,cinder:UPDATE=128,cinder:INSERT=39,cinder:DELETE=8 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:38 devstack sudo[99469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:25:38 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:39 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.582s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:39 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:25:39 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-22d322f5-2b4f-436c-83d2-f0121c8b6a04 tempest-GroupsTest-851826050 None] Delete group completed successfully.
Sep 29 18:25:39 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-dee1da0d-df49-4008-84f9-6a5646141409 tempest-GroupsTest-851826050 None] Created reservations ['1985d57a-42c0-4394-ae2d-2371d6e746ae'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dee1da0d-df49-4008-84f9-6a5646141409 tempest-GroupsTest-851826050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dee1da0d-df49-4008-84f9-6a5646141409 tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dee1da0d-df49-4008-84f9-6a5646141409 tempest-GroupsTest-851826050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dee1da0d-df49-4008-84f9-6a5646141409 tempest-GroupsTest-851826050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dee1da0d-df49-4008-84f9-6a5646141409 tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dee1da0d-df49-4008-84f9-6a5646141409 tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:40 devstack sudo[99492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:25:40 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:40 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dee1da0d-df49-4008-84f9-6a5646141409 tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.378s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:40 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-dee1da0d-df49-4008-84f9-6a5646141409 tempest-GroupsTest-851826050 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:25:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-dee1da0d-df49-4008-84f9-6a5646141409 tempest-GroupsTest-851826050 None] Delete group completed successfully.
Sep 29 18:25:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bec8b9bc-66dd-478c-adff-b21b2f6722cb tempest-GroupsTest-851826050 None] Group tempest-GroupsTest-Group-442213248: creating
Sep 29 18:25:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bec8b9bc-66dd-478c-adff-b21b2f6722cb tempest-GroupsTest-851826050 None] Group tempest-GroupsTest-Group-442213248: created successfully
Sep 29 18:25:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bec8b9bc-66dd-478c-adff-b21b2f6722cb tempest-GroupsTest-851826050 None] Create group completed successfully.
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Flow 'volume_create_manager' (a9ef27ab-2179-4f36-85a0-d1e1ade800cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294dcaf4-95c4-494a-ac24-2c4a7e02523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294dcaf4-95c4-494a-ac24-2c4a7e02523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-81750767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8338ef4c-2b52-4871-b1f5-90ced7cf13e3,host='devstack@QuobyteHD#QuobyteHD',id=96396e35-a9e3-46e0-97a3-acda3a135fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b87bd2a051d4362acbcd9028ad78c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:44Z,use_quota=True,user_id='42231b59a108487b878052bcf3e43ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a66dfcba-6a5c-49af-bdb7-b0b1079bc560),volume_type_id=a66dfcba-6a5c-49af-bdb7-b0b1079bc560)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4cb5f9-f569-4a91-b4c2-0941609c1d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4cb5f9-f569-4a91-b4c2-0941609c1d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620b442d-9447-4cb5-aaaa-aa85def8366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620b442d-9447-4cb5-aaaa-aa85def8366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96396e35-a9e3-46e0-97a3-acda3a135fca', 'volume_name': 'volume-96396e35-a9e3-46e0-97a3-acda3a135fca', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470f3325-40e3-462c-9b46-c68835ad99f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470f3325-40e3-462c-9b46-c68835ad99f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2dc0a0-7419-4a39-a14e-9f390f92957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:44 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Volume 96396e35-a9e3-46e0-97a3-acda3a135fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96396e35-a9e3-46e0-97a3-acda3a135fca', 'volume_size': 1}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8338ef4c-2b52-4871-b1f5-90ced7cf13e3,created_at=2026-09-29T16:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-81750767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8338ef4c-2b52-4871-b1f5-90ced7cf13e3,host='devstack@QuobyteHD#QuobyteHD',id=96396e35-a9e3-46e0-97a3-acda3a135fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b87bd2a051d4362acbcd9028ad78c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:44Z,use_quota=True,user_id='42231b59a108487b878052bcf3e43ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a66dfcba-6a5c-49af-bdb7-b0b1079bc560),volume_type_id=a66dfcba-6a5c-49af-bdb7-b0b1079bc560)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Creating volume 96396e35-a9e3-46e0-97a3-acda3a135fca {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:25:44 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:25:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:44 devstack sudo[99577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca 1073741824
Sep 29 18:25:44 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:45 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca 1073741824" returned: 0 in 0.984s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:45 devstack sudo[99586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca
Sep 29 18:25:45 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:45 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca" returned: 0 in 0.373s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:25:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2dc0a0-7419-4a39-a14e-9f390f92957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96396e35-a9e3-46e0-97a3-acda3a135fca', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1203ae6-667a-4a5f-879b-92d5a53f6d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:45 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Volume volume-96396e35-a9e3-46e0-97a3-acda3a135fca (96396e35-a9e3-46e0-97a3-acda3a135fca): created successfully
Sep 29 18:25:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1203ae6-667a-4a5f-879b-92d5a53f6d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Flow 'volume_create_manager' (a9ef27ab-2179-4f36-85a0-d1e1ade800cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bb080688-00ea-4981-925b-46473e87977d tempest-GroupsTest-851826050 None] Created volume successfully.
Sep 29 18:25:47 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:25:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Flow 'volume_create_manager' (c4e68a09-b45b-42d2-a52d-25a4af01a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265af4fe-ffe4-4b2d-8785-c255a73059ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265af4fe-ffe4-4b2d-8785-c255a73059ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-975452232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8338ef4c-2b52-4871-b1f5-90ced7cf13e3,host='devstack@QuobyteHD#QuobyteHD',id=8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b87bd2a051d4362acbcd9028ad78c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:48Z,use_quota=True,user_id='42231b59a108487b878052bcf3e43ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a66dfcba-6a5c-49af-bdb7-b0b1079bc560),volume_type_id=a66dfcba-6a5c-49af-bdb7-b0b1079bc560)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a3c121-291f-45fa-b1e8-083ce87dbb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a3c121-291f-45fa-b1e8-083ce87dbb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5a3c49-e409-457c-b0d4-56c4b3af22dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5a3c49-e409-457c-b0d4-56c4b3af22dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32', 'volume_name': 'volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebc51c1-f944-461b-8a32-6bed63f266e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebc51c1-f944-461b-8a32-6bed63f266e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700d2db8-c875-4dfe-bcc1-fcaffe80a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:48 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Volume 8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32', 'volume_size': 1}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8338ef4c-2b52-4871-b1f5-90ced7cf13e3,created_at=2026-09-29T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-975452232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8338ef4c-2b52-4871-b1f5-90ced7cf13e3,host='devstack@QuobyteHD#QuobyteHD',id=8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b87bd2a051d4362acbcd9028ad78c65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:48Z,use_quota=True,user_id='42231b59a108487b878052bcf3e43ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a66dfcba-6a5c-49af-bdb7-b0b1079bc560),volume_type_id=a66dfcba-6a5c-49af-bdb7-b0b1079bc560)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Creating volume 8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:25:48 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:48 devstack sudo[99612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32 1073741824
Sep 29 18:25:48 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:48 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32 1073741824" returned: 0 in 0.799s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:48 devstack sudo[99620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32
Sep 29 18:25:48 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:49 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32" returned: 0 in 0.371s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700d2db8-c875-4dfe-bcc1-fcaffe80a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4983c41d-e606-45ff-a2c3-6dd9354b6636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:49 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Volume volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32 (8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32): created successfully
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4983c41d-e606-45ff-a2c3-6dd9354b6636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Flow 'volume_create_manager' (c4e68a09-b45b-42d2-a52d-25a4af01a953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:49 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-9ae09ce6-adb0-44a8-bafb-f886059d190d tempest-GroupsTest-851826050 None] Created volume successfully.
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Flow 'volume_create_manager' (03859e82-209d-468e-82b2-05d4cabdb6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c8e460-3c44-4209-bff8-be57c37a844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c8e460-3c44-4209-bff8-be57c37a844a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-35641229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ff60ae-f806-4c00-a12c-48733d2b338d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec2050d73c84be4a70b71077c9632f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:50Z,use_quota=True,user_id='a98865a0b58d4f20a143f191de3cec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045978f5-147c-45cb-82ff-d84bb81c7237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045978f5-147c-45cb-82ff-d84bb81c7237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e3c68d-2b64-4a02-86b1-940fb81add13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e3c68d-2b64-4a02-86b1-940fb81add13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45ff60ae-f806-4c00-a12c-48733d2b338d', 'volume_name': 'volume-45ff60ae-f806-4c00-a12c-48733d2b338d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c65c46-7ae0-4b88-99ed-b80e3e01f430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c65c46-7ae0-4b88-99ed-b80e3e01f430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cc28e8-2cde-408a-9512-a74d955e30d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:49 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Volume 45ff60ae-f806-4c00-a12c-48733d2b338d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45ff60ae-f806-4c00-a12c-48733d2b338d', 'volume_size': 1}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-35641229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ff60ae-f806-4c00-a12c-48733d2b338d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec2050d73c84be4a70b71077c9632f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:50Z,use_quota=True,user_id='a98865a0b58d4f20a143f191de3cec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Creating volume 45ff60ae-f806-4c00-a12c-48733d2b338d {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:25:49 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:25:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:49 devstack sudo[99624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d 1073741824
Sep 29 18:25:49 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:50 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bfc75665-6ad5-42e8-8823-3ffb670b466a tempest-GroupsTest-851826050 None] Update group completed successfully.
Sep 29 18:25:50 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d 1073741824" returned: 0 in 0.696s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:50 devstack sudo[99630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d
Sep 29 18:25:50 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:50 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:25:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cc28e8-2cde-408a-9512-a74d955e30d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ff60ae-f806-4c00-a12c-48733d2b338d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dde7c5-c701-4dc1-bd3f-c43998e4f484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:50 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Volume volume-45ff60ae-f806-4c00-a12c-48733d2b338d (45ff60ae-f806-4c00-a12c-48733d2b338d): created successfully
Sep 29 18:25:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dde7c5-c701-4dc1-bd3f-c43998e4f484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Flow 'volume_create_manager' (03859e82-209d-468e-82b2-05d4cabdb6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:50 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-35bf804a-f54b-4370-96c4-2be93a914415 tempest-VolumesListAdminTestJSON-699326200 None] Created volume successfully.
Sep 29 18:25:51 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-34bb31eb-f3f7-4669-a73b-a2ead5228c7f tempest-GroupsTest-851826050 None] Update group completed successfully.
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Flow 'volume_create_manager' (9814789d-a4de-4d6f-8e14-2df763c71bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8ba32f-28b1-4d97-8483-1036fe6a0f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8ba32f-28b1-4d97-8483-1036fe6a0f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-342731354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f310aeea-5a37-4f75-aab2-948c0ca36cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec2050d73c84be4a70b71077c9632f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:52Z,use_quota=True,user_id='a98865a0b58d4f20a143f191de3cec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb04a497-9795-4cc6-97ac-2529dbf0f641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb04a497-9795-4cc6-97ac-2529dbf0f641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c561dc90-59f8-4f56-aea6-99672a886b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c561dc90-59f8-4f56-aea6-99672a886b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f310aeea-5a37-4f75-aab2-948c0ca36cbb', 'volume_name': 'volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bddb9bf-bf7f-4d8a-83bc-0c1172214663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bddb9bf-bf7f-4d8a-83bc-0c1172214663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98682a59-5330-4656-9a40-12f25408ab2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:52 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Volume f310aeea-5a37-4f75-aab2-948c0ca36cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb', 'volume_size': 1}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-342731354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f310aeea-5a37-4f75-aab2-948c0ca36cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec2050d73c84be4a70b71077c9632f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:52Z,use_quota=True,user_id='a98865a0b58d4f20a143f191de3cec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Creating volume f310aeea-5a37-4f75-aab2-948c0ca36cbb {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:25:52 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:25:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:52 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb 1073741824
Sep 29 18:25:52 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:53 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb 1073741824" returned: 0 in 0.553s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:53 devstack sudo[99643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb
Sep 29 18:25:53 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:53 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb" returned: 0 in 0.305s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98682a59-5330-4656-9a40-12f25408ab2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c2dcff-14b6-414b-8eed-002f70f322e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:53 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Volume volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb (f310aeea-5a37-4f75-aab2-948c0ca36cbb): created successfully
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c2dcff-14b6-414b-8eed-002f70f322e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Flow 'volume_create_manager' (9814789d-a4de-4d6f-8e14-2df763c71bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:53 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-df40818a-789e-4576-be4f-ba43fd16ddc5 tempest-VolumesListAdminTestJSON-699326200 None] Created volume successfully.
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Acquiring lock "cinder-quobyte-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Lock "cinder-quobyte-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f606c9-542c-49ad-842b-be9041829e68]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:53 devstack sudo[99647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32
Sep 29 18:25:53 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:54 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32" returned: 0 in 0.491s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:54 devstack sudo[99652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32
Sep 29 18:25:54 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:54 devstack sudo[99654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:25:54 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:54 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32" returned: 0 in 0.331s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Lock "cinder-quobyte-8fdb4fdf-90c2-40f9-97b8-2cea6eef8a32" released by "delete_volume" :: held 0.900s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Acquiring lock "cinder-quobyte-96396e35-a9e3-46e0-97a3-acda3a135fca" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Lock "cinder-quobyte-96396e35-a9e3-46e0-97a3-acda3a135fca" acquired by "delete_volume" :: waited 0.036s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:54 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.350s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8643d81-4eff-48f6-84d0-35aea9888b5c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:25:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:25:54 devstack sudo[99658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca
Sep 29 18:25:54 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:55 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca" returned: 0 in 0.614s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:55 devstack sudo[99665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca
Sep 29 18:25:55 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Flow 'volume_create_manager' (9ccff3f1-0e12-47ed-821f-e8ffc2be19f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c509cd-38ee-4e6a-9505-09441f40fe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c509cd-38ee-4e6a-9505-09441f40fe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-145772156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95268841-3435-44fe-9345-b3777d9c0ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec2050d73c84be4a70b71077c9632f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:56Z,use_quota=True,user_id='a98865a0b58d4f20a143f191de3cec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:55 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c7a976-11eb-4ea8-9788-2d092507b096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c7a976-11eb-4ea8-9788-2d092507b096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b0456e-2738-4bee-9a2f-bc422bb16249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b0456e-2738-4bee-9a2f-bc422bb16249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95268841-3435-44fe-9345-b3777d9c0ca5', 'volume_name': 'volume-95268841-3435-44fe-9345-b3777d9c0ca5', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee3a92c-fd00-49f5-b9ae-104b882d10d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee3a92c-fd00-49f5-b9ae-104b882d10d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592c7795-736b-4f0e-a02e-307cd8662db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:55 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Volume 95268841-3435-44fe-9345-b3777d9c0ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95268841-3435-44fe-9345-b3777d9c0ca5', 'volume_size': 1}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-145772156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95268841-3435-44fe-9345-b3777d9c0ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec2050d73c84be4a70b71077c9632f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:56Z,use_quota=True,user_id='a98865a0b58d4f20a143f191de3cec68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Creating volume 95268841-3435-44fe-9345-b3777d9c0ca5 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:25:55 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-96396e35-a9e3-46e0-97a3-acda3a135fca" returned: 0 in 0.377s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Lock "cinder-quobyte-96396e35-a9e3-46e0-97a3-acda3a135fca" released by "delete_volume" :: held 1.063s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:55 devstack sudo[99668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5 1073741824
Sep 29 18:25:55 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Created reservations ['85c20225-5b75-4e3d-aa8f-06f6baea700e'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:55 devstack cinder-volume[86821]: WARNING cinder.quota [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1612951391 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1612951391, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:25:55 devstack cinder-volume[86821]: WARNING cinder.quota [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1612951391 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1612951391, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:25:55 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Created reservations ['d2f0f172-2c85-47cc-852b-5074d3245a6e', 'af061208-e063-4c44-bb7e-91afb5083488', 'b479a5d6-f5d3-447a-b758-5abd03494c0e', '5700e3c7-ce39-4cdb-81d5-13049632826e'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Created reservations ['ba241e58-dd69-4556-aafe-36a27d8a783e', '6b76a868-b086-4b14-82d5-17643dbd5c15', '74bfbce0-831f-4949-8776-104a726a65a4', 'a387c429-acf1-487b-9da7-531f45e8187e'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:56 devstack sudo[99674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:25:56 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:56 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5 1073741824" returned: 0 in 0.650s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:56 devstack sudo[99676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5
Sep 29 18:25:56 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:56 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.382s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:25:56 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bb81a432-b369-45a8-9507-02887c1ebe0b tempest-GroupsTest-851826050 None] Delete group completed successfully.
Sep 29 18:25:56 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5" returned: 0 in 0.331s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592c7795-736b-4f0e-a02e-307cd8662db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95268841-3435-44fe-9345-b3777d9c0ca5', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55526ce4-0b5d-4708-bf3d-e878f1096fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:56 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Volume volume-95268841-3435-44fe-9345-b3777d9c0ca5 (95268841-3435-44fe-9345-b3777d9c0ca5): created successfully
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55526ce4-0b5d-4708-bf3d-e878f1096fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Flow 'volume_create_manager' (9ccff3f1-0e12-47ed-821f-e8ffc2be19f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:56 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-dd953929-aa1f-4dd5-b231-2e136647bdd7 tempest-VolumesListAdminTestJSON-699326200 None] Created volume successfully.
Sep 29 18:25:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Acquiring lock "cinder-0e7d5b7a-abed-4eb3-be55-9252388cc18d-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Lock "cinder-0e7d5b7a-abed-4eb3-be55-9252388cc18d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Acquiring lock "cinder-quobyte-0e7d5b7a-abed-4eb3-be55-9252388cc18d" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:25:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Lock "cinder-quobyte-0e7d5b7a-abed-4eb3-be55-9252388cc18d" acquired by "delete_volume" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:25:58 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69c4641-bcfc-41a2-aa71-b5e4c370fbb0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:25:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:58 devstack sudo[99680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d
Sep 29 18:25:58 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:58 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Flow 'volume_create_manager' (ce74f190-5561-4497-ac93-0eff4ee89c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:25:59 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8faa2b-de70-4380-91bf-4433fe9ef8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d" returned: 0 in 0.535s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8faa2b-de70-4380-91bf-4433fe9ef8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eef7af4-7169-4fcf-bf06-6965e27c5b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad8ce901d14462aa0d8c45b41482f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:59Z,use_quota=True,user_id='835c6552e8ec4788b7fcfb26b2e251b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:59 devstack sudo[99685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071eed79-d1c3-4161-9afa-57a51871dcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:59 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071eed79-d1c3-4161-9afa-57a51871dcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92079ab-5c0f-4be9-986b-05289bb00f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92079ab-5c0f-4be9-986b-05289bb00f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eef7af4-7169-4fcf-bf06-6965e27c5b00', 'volume_name': 'volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd79694a-b73b-41f7-9137-87e34fc2a38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd79694a-b73b-41f7-9137-87e34fc2a38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbd99ba-42c0-4844-8f88-150349158161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:25:59 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Volume 5eef7af4-7169-4fcf-bf06-6965e27c5b00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00', 'volume_size': 1}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eef7af4-7169-4fcf-bf06-6965e27c5b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad8ce901d14462aa0d8c45b41482f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:59Z,use_quota=True,user_id='835c6552e8ec4788b7fcfb26b2e251b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Creating volume 5eef7af4-7169-4fcf-bf06-6965e27c5b00 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:25:59 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:59 devstack sudo[99687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00 1073741824
Sep 29 18:25:59 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:59 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0e7d5b7a-abed-4eb3-be55-9252388cc18d" returned: 0 in 0.294s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Lock "cinder-quobyte-0e7d5b7a-abed-4eb3-be55-9252388cc18d" released by "delete_volume" :: held 0.889s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Created reservations ['a62cbd37-3f09-4f47-ad5a-4fee01fd2c26', 'a582cd69-9642-4886-8277-fa840f57e413', 'e8ed9ef4-0af8-4224-a405-d1d1d2435296', '4f38a053-f5d9-4522-ad68-4227d8c60ad1'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:59 devstack sudo[99694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:25:59 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:59 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00 1073741824" returned: 0 in 0.622s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:25:59 devstack sudo[99696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00
Sep 29 18:25:59 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:25:59 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.330s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:25:59 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Deleted volume successfully.
Sep 29 18:25:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-66dd3986-71e1-4823-bc4c-19c3a4d35979 tempest-VolumesNegativeTest-1820965346 None] Lock "cinder-0e7d5b7a-abed-4eb3-be55-9252388cc18d-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:00 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00" returned: 0 in 0.327s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:26:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbd99ba-42c0-4844-8f88-150349158161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3d2826-b980-408a-9409-f1edcb8e7ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:00 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Volume volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00 (5eef7af4-7169-4fcf-bf06-6965e27c5b00): created successfully
Sep 29 18:26:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3d2826-b980-408a-9409-f1edcb8e7ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Flow 'volume_create_manager' (ce74f190-5561-4497-ac93-0eff4ee89c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:00 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8d694202-b00e-4a07-b2f1-d8fe57148250 tempest-VolumesListAdminTestJSON-723297621 None] Created volume successfully.
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Acquiring lock "cinder-5eef7af4-7169-4fcf-bf06-6965e27c5b00-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Lock "cinder-5eef7af4-7169-4fcf-bf06-6965e27c5b00-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Acquiring lock "cinder-quobyte-5eef7af4-7169-4fcf-bf06-6965e27c5b00" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Lock "cinder-quobyte-5eef7af4-7169-4fcf-bf06-6965e27c5b00" acquired by "delete_volume" :: waited 0.037s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccf0c66-5043-44cf-b09b-22dbc8a89cd7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "cinder-95268841-3435-44fe-9345-b3777d9c0ca5-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-95268841-3435-44fe-9345-b3777d9c0ca5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:01 devstack sudo[99700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00
Sep 29 18:26:01 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "cinder-quobyte-95268841-3435-44fe-9345-b3777d9c0ca5" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-quobyte-95268841-3435-44fe-9345-b3777d9c0ca5" acquired by "delete_volume" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d4b14f-9671-4898-a9c9-c33f4423d38c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:02 devstack sudo[99702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5
Sep 29 18:26:02 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:02 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00" returned: 0 in 0.602s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:02 devstack sudo[99707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00
Sep 29 18:26:02 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:02 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5" returned: 0 in 0.567s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:02 devstack sudo[99712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5
Sep 29 18:26:02 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:02 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5eef7af4-7169-4fcf-bf06-6965e27c5b00" returned: 0 in 0.398s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Lock "cinder-quobyte-5eef7af4-7169-4fcf-bf06-6965e27c5b00" released by "delete_volume" :: held 1.110s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Created reservations ['fdcb196d-66ec-40e2-b71b-02233a2fb8f7', '912c84f2-fa36-4e17-b165-253a483722e6', '4be0b93c-3e79-443c-af05-67478cf5a028', '4d679ea0-f052-42fc-a61d-f8127b821ca6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:26:02 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-95268841-3435-44fe-9345-b3777d9c0ca5" returned: 0 in 0.334s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-quobyte-95268841-3435-44fe-9345-b3777d9c0ca5" released by "delete_volume" :: held 0.985s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:02 devstack sudo[99717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:26:02 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:02 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Created reservations ['53c7d1dd-61e4-4c24-a828-59250e520b3b', 'a71d68a3-2faf-41b0-b922-ba1c31fc401c', 'fb1767fc-0afd-4128-b46e-35bd4a476cc3', '3a457d1c-edd1-45e3-bc33-d43a51725071'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:03 devstack sudo[99719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:26:03 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:03 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.390s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:26:03 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Deleted volume successfully.
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9d3f623f-a1e4-415e-91cb-9390121b5d2e tempest-VolumesListAdminTestJSON-723297621 None] Lock "cinder-5eef7af4-7169-4fcf-bf06-6965e27c5b00-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:03 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.369s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:26:03 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Deleted volume successfully.
Sep 29 18:26:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e248d7f3-2669-48c7-93fc-8b9cd1286446 tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-95268841-3435-44fe-9345-b3777d9c0ca5-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "cinder-f310aeea-5a37-4f75-aab2-948c0ca36cbb-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-f310aeea-5a37-4f75-aab2-948c0ca36cbb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "cinder-quobyte-f310aeea-5a37-4f75-aab2-948c0ca36cbb" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-quobyte-f310aeea-5a37-4f75-aab2-948c0ca36cbb" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:04 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d7231c-5d54-408b-b0ab-dc7af737ac0e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:04 devstack sudo[99724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb
Sep 29 18:26:04 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:04 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb" returned: 0 in 0.538s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:04 devstack sudo[99730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb
Sep 29 18:26:04 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:05 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-f310aeea-5a37-4f75-aab2-948c0ca36cbb" returned: 0 in 0.410s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-quobyte-f310aeea-5a37-4f75-aab2-948c0ca36cbb" released by "delete_volume" :: held 1.061s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Created reservations ['b4979687-8097-487d-81b5-d8988579283f', '4e4f0ed9-c398-4331-8383-6e9ab8d8439e', '8467279d-8f04-4950-9564-bed25db6bb59', '134cf818-3de4-4767-8f2a-28cbb57610b4'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:05 devstack sudo[99733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:26:05 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:05 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.323s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:26:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Deleted volume successfully.
Sep 29 18:26:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e1ebba8-4e3a-4ece-8778-91eecd858c8b tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-f310aeea-5a37-4f75-aab2-948c0ca36cbb-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:06 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0079c212-ea7d-41e8-bc0f-533db7ee4e55 tempest-GroupsV314Test-558734456 None] Group tempest-GroupsV314Test-Group-798562127: creating
Sep 29 18:26:06 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0079c212-ea7d-41e8-bc0f-533db7ee4e55 tempest-GroupsV314Test-558734456 None] Group tempest-GroupsV314Test-Group-798562127: created successfully
Sep 29 18:26:06 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0079c212-ea7d-41e8-bc0f-533db7ee4e55 tempest-GroupsV314Test-558734456 None] Create group completed successfully.
Sep 29 18:26:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "cinder-45ff60ae-f806-4c00-a12c-48733d2b338d-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-45ff60ae-f806-4c00-a12c-48733d2b338d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "cinder-quobyte-45ff60ae-f806-4c00-a12c-48733d2b338d" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-quobyte-45ff60ae-f806-4c00-a12c-48733d2b338d" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:06 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2bcd93-1da0-4ba4-bf0d-4b99b4cdbfa2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:06 devstack sudo[99737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d
Sep 29 18:26:06 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:07 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d" returned: 0 in 0.465s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:07 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d
Sep 29 18:26:07 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:07 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-45ff60ae-f806-4c00-a12c-48733d2b338d" returned: 0 in 0.354s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-quobyte-45ff60ae-f806-4c00-a12c-48733d2b338d" released by "delete_volume" :: held 0.887s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:07 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Created reservations ['47108b6d-b318-4494-8021-bb838965effc', 'c8b1c2e5-0a8b-46a3-b320-4241e72c60a7', 'd6630305-4201-484f-b9ce-8551bb40b8cc', '84aa8368-85ca-4ef7-b7ce-9f8475073eaf'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:26:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:07 devstack sudo[99746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:26:07 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:08 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.648s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:26:08 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Deleted volume successfully.
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Flow 'volume_create_manager' (6eb92acc-8349-4e40-ad79-4f366e93d08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa8b5a4-1b34-477d-a858-36810bf958e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa8b5a4-1b34-477d-a858-36810bf958e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-146263970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=374f91d8-c6ec-4ba5-b44f-a5132f973a2a,host='devstack@QuobyteHD#QuobyteHD',id=0f7a985e-b9b3-4677-8fe2-ca36a6acf781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eca21a708e4be5bd2e2611a34ccf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:08Z,use_quota=True,user_id='e3edb077abdf4ef0833d26451a9c4eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1eb0593f-c708-4fcf-a048-87e8648bf7d9),volume_type_id=1eb0593f-c708-4fcf-a048-87e8648bf7d9)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe451fa-3ba6-4472-b39f-cb619a3d9ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe451fa-3ba6-4472-b39f-cb619a3d9ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57dad645-e700-463a-b9f8-8a2685125543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57dad645-e700-463a-b9f8-8a2685125543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f7a985e-b9b3-4677-8fe2-ca36a6acf781', 'volume_name': 'volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb44f98-53a0-44b2-8984-17b50d2654e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb44f98-53a0-44b2-8984-17b50d2654e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d0f14c-3030-465c-81cc-7535b8ed0462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:08 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Volume 0f7a985e-b9b3-4677-8fe2-ca36a6acf781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781', 'volume_size': 1}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=374f91d8-c6ec-4ba5-b44f-a5132f973a2a,created_at=2026-09-29T16:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-146263970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=374f91d8-c6ec-4ba5-b44f-a5132f973a2a,host='devstack@QuobyteHD#QuobyteHD',id=0f7a985e-b9b3-4677-8fe2-ca36a6acf781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47eca21a708e4be5bd2e2611a34ccf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:08Z,use_quota=True,user_id='e3edb077abdf4ef0833d26451a9c4eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1eb0593f-c708-4fcf-a048-87e8648bf7d9),volume_type_id=1eb0593f-c708-4fcf-a048-87e8648bf7d9)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Creating volume 0f7a985e-b9b3-4677-8fe2-ca36a6acf781 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:26:08 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:08 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4eb7d73d-42f9-4930-86df-112f428fd362 tempest-VolumesListAdminTestJSON-699326200 None] Lock "cinder-45ff60ae-f806-4c00-a12c-48733d2b338d-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:08 devstack sudo[99749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 1073741824
Sep 29 18:26:08 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:09 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 1073741824" returned: 0 in 0.717s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:09 devstack sudo[99755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781
Sep 29 18:26:09 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:09 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781" returned: 0 in 0.331s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:26:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d0f14c-3030-465c-81cc-7535b8ed0462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cf2f20-7846-4e0a-b579-16f2863120f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:09 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Volume volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 (0f7a985e-b9b3-4677-8fe2-ca36a6acf781): created successfully
Sep 29 18:26:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cf2f20-7846-4e0a-b579-16f2863120f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Flow 'volume_create_manager' (6eb92acc-8349-4e40-ad79-4f366e93d08b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:09 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e590e23c-ed54-43f9-9d5d-4426cd80d178 tempest-GroupsV314Test-558734456 None] Created volume successfully.
Sep 29 18:26:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:11 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Cloning volume 0f7a985e-b9b3-4677-8fe2-ca36a6acf781 to volume 0c904ea9-d54d-49e4-8304-57ea4342bc0e
Sep 29 18:26:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Creating offline snapshot c798676c-512c-433a-b5d8-401a210f791b of volume 0f7a985e-b9b3-4677-8fe2-ca36a6acf781 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:26:11 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[476ccbfb-1f42-49f4-a0d7-4286fc6537b6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:11 devstack sudo[99758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781
Sep 29 18:26:11 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:11 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781" returned: 0 in 0.571s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:12 devstack sudo[99763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b 1G
Sep 29 18:26:12 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:12 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b 1G" returned: 0 in 0.552s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:12 devstack sudo[99769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b
Sep 29 18:26:12 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:12 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b" returned: 0 in 0.428s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:12 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:26:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:13 devstack sudo[99776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b
Sep 29 18:26:13 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:13 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b" returned: 0 in 0.391s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:13 devstack sudo[99781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.info
Sep 29 18:26:13 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:13 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.info" returned: 0 in 0.349s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:13 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:26:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:13 devstack sudo[99784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.info
Sep 29 18:26:13 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:14 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.info" returned: 0 in 0.364s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Acquiring lock "cinder-quobyte-0c904ea9-d54d-49e4-8304-57ea4342bc0e" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Lock "cinder-quobyte-0c904ea9-d54d-49e4-8304-57ea4342bc0e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] snapshot: c798676c-512c-433a-b5d8-401a210f791b, volume: 0c904ea9-d54d-49e4-8304-57ea4342bc0e,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f761ed-68c7-4710-80b9-2779e34492ba]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:14 devstack sudo[99787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b
Sep 29 18:26:14 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:14 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b" returned: 0 in 0.435s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee3f91b-8e5c-45a4-b807-a69642c26ce1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:14 devstack sudo[99792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781
Sep 29 18:26:14 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:15 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781" returned: 0 in 0.473s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:26:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:26:15 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:26:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:15 devstack sudo[99798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e
Sep 29 18:26:15 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:23 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=82,cinder:SELECT=73,cinder:DELETE=6,cinder:INSERT=22 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:26:23 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=102,cinder:SELECT=70,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:26:24 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e" returned: 0 in 9.798s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:24 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781, size 1024.00 MB, duration 9.80 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:26:24 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Converted 1024.00 MB image at 104.50 MB/s
Sep 29 18:26:24 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e is being set with open permissions: ugo+rw: NotImplementedError
Sep 29 18:26:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:25 devstack sudo[99847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e
Sep 29 18:26:25 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:25 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e" returned: 0 in 0.319s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Lock "cinder-quobyte-0c904ea9-d54d-49e4-8304-57ea4342bc0e" released by "_copy_volume_from_snapshot" :: held 11.127s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Acquiring lock "cinder-quobyte-c798676c-512c-433a-b5d8-401a210f791b" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Lock "cinder-quobyte-c798676c-512c-433a-b5d8-401a210f791b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Deleting offline snapshot c798676c-512c-433a-b5d8-401a210f791b of volume 0f7a985e-b9b3-4677-8fe2-ca36a6acf781 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] snapshot_file for this snap is: volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[06041f00-a5bd-4269-9bf9-7e02f9b63257]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:25 devstack sudo[99850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b
Sep 29 18:26:25 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:25 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b" returned: 0 in 0.483s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b40c7d6-eb63-469a-8969-b9ac82ddcde4]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:26 devstack sudo[99855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781
Sep 29 18:26:26 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Flow 'volume_create_manager' (5b2e7774-2aab-4a9c-b5b2-22f0af82654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528faa74-b2e2-4c14-8f7b-f58314a0b57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528faa74-b2e2-4c14-8f7b-f58314a0b57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-878051265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7214be5-e814-42b1-bc56-e746bbb1abb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e1ea3bfa124410a8bbb4feab20e84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:26Z,use_quota=True,user_id='cc73f03158a9417e8dd8ee9e5b0e9a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce4f001-f7ab-4cb6-8a93-6b3b21c4ab97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce4f001-f7ab-4cb6-8a93-6b3b21c4ab97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72792549-fba0-41d3-8af5-d03a635a1710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.image.glance [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Creating Keystone auth plugin from conf {{(pid=86821) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 18:26:26 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781" returned: 0 in 0.787s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:26 devstack sudo[99860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b
Sep 29 18:26:26 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72792549-fba0-41d3-8af5-d03a635a1710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7214be5-e814-42b1-bc56-e746bbb1abb1', 'volume_name': 'volume-b7214be5-e814-42b1-bc56-e746bbb1abb1', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b96e5bb60>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d715469e-b752-429f-80a4-fc8b8f94dad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d715469e-b752-429f-80a4-fc8b8f94dad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15d6900-173d-49be-8e96-b03cfaca27de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Volume b7214be5-e814-42b1-bc56-e746bbb1abb1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7214be5-e814-42b1-bc56-e746bbb1abb1', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b96e5bb60>}
Sep 29 18:26:26 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Trying to clone b7214be5-e814-42b1-bc56-e746bbb1abb1 from image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]). {{(pid=86821) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 18:26:27 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b" returned: 0 in 0.650s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:27 devstack sudo[99865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b
Sep 29 18:26:27 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:27 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 18:26:27 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 18:26:27 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad242c93-3151-4838-9ccb-76f0ffe89eaf]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:27 devstack sudo[99868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD
Sep 29 18:26:27 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:27 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781.c798676c-512c-433a-b5d8-401a210f791b" returned: 0 in 0.401s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Lock "cinder-quobyte-c798676c-512c-433a-b5d8-401a210f791b" released by "_delete_snapshot" :: held 2.487s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.532s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0cdc3080-ccf1-4f4a-b93f-dd76f74ce02d tempest-GroupsV314Test-558734456 None] Create group from source-group-374f91d8-c6ec-4ba5-b44f-a5132f973a2a completed successfully.
Sep 29 18:26:28 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Temporary image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb is fetched for user cc73f03158a9417e8dd8ee9e5b0e9a5b. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92ae7c0-d4ad-4820-93d8-2aded09c9b09]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:28 devstack sudo[99874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD
Sep 29 18:26:28 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:26:28 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Flow 'volume_create_manager' (e9218ec2-040b-4496-9a90-95186cce26f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0ff5cd-3823-4f83-80ac-b4f404fe78fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-878051265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7214be5-e814-42b1-bc56-e746bbb1abb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e1ea3bfa124410a8bbb4feab20e84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:26Z,use_quota=True,user_id='cc73f03158a9417e8dd8ee9e5b0e9a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Creating volume b7214be5-e814-42b1-bc56-e746bbb1abb1 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:26:28 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0ff5cd-3823-4f83-80ac-b4f404fe78fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1740822212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec21f922212d4f40aaacb8e9c147106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:28Z,use_quota=True,user_id='a4badf97f3184377a050a4a826e889b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1463c74b-bfee-43f9-a76d-12827525fc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1463c74b-bfee-43f9-a76d-12827525fc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dd0a01-c483-4a29-88c4-8fbc69e56ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dd0a01-c483-4a29-88c4-8fbc69e56ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6', 'volume_name': 'volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:28 devstack sudo[99879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 1073741824
Sep 29 18:26:28 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149397f5-4b62-47c8-97f4-7117090126b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149397f5-4b62-47c8-97f4-7117090126b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234b271a-ccf7-4a63-9b90-6244af3a794f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:28 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Volume e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6', 'volume_size': 1}
Sep 29 18:26:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Acquiring lock "cinder-quobyte-0c904ea9-d54d-49e4-8304-57ea4342bc0e" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Lock "cinder-quobyte-0c904ea9-d54d-49e4-8304-57ea4342bc0e" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce28c7b1-2333-4237-9b70-8a9cf0fb0572]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:29 devstack sudo[99885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e
Sep 29 18:26:29 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:29 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 1073741824" returned: 0 in 0.760s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:29 devstack sudo[99887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1
Sep 29 18:26:29 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:29 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e" returned: 0 in 0.526s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:29 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1" returned: 0 in 0.311s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.061s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1740822212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec21f922212d4f40aaacb8e9c147106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:28Z,use_quota=True,user_id='a4badf97f3184377a050a4a826e889b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Creating volume e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:29 devstack sudo[99893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e
Sep 29 18:26:29 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:26:29 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:29 devstack sudo[99895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 1073741824
Sep 29 18:26:29 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Attempting download of d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb ((None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}])) to volume b7214be5-e814-42b1-bc56-e746bbb1abb1. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[33266ca3-c64e-464d-9168-c0e4560d7260]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_g55vbbrz {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:29 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c904ea9-d54d-49e4-8304-57ea4342bc0e" returned: 0 in 0.296s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Lock "cinder-quobyte-0c904ea9-d54d-49e4-8304-57ea4342bc0e" released by "delete_volume" :: held 0.888s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:30 devstack sudo[99897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_g55vbbrz
Sep 29 18:26:30 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Created reservations ['fab4fbbb-aa0a-43f4-aa4d-e1e3bca94fd5'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:26:30 devstack cinder-volume[86821]: WARNING cinder.quota [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-102414624 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-102414624, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:26:30 devstack cinder-volume[86821]: WARNING cinder.quota [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-102414624 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-102414624, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Created reservations ['58c445b0-5f0b-43ce-9ffe-fa05254db5b2', '93cfa9e5-6041-43c7-9075-032ff27cb945', 'deb39b07-1d20-492b-9dc9-44d84846177f', '36f3ecb9-5baa-49d9-b203-a83cbc387bb8'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:30 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_g55vbbrz" returned: 0 in 0.457s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:30 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_g55vbbrz {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 1073741824" returned: 0 in 0.603s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:30 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:26:30 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:30 devstack sudo[99909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6
Sep 29 18:26:30 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:30 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_g55vbbrz
Sep 29 18:26:30 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:30 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.443s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:26:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-82807699-d6dc-4f19-9776-c48bf49b8d29 tempest-GroupsV314Test-558734456 None] Delete group completed successfully.
Sep 29 18:26:30 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6" returned: 0 in 0.402s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:30 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234b271a-ccf7-4a63-9b90-6244af3a794f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe5ddcb-4b65-43e2-bb75-fed413519cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_g55vbbrz" returned: 1 in 0.510s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_g55vbbrz' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d93a6e-242b-49e8-8c0e-1ed401752879]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:30 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Volume volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 (e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6): created successfully
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe5ddcb-4b65-43e2-bb75-fed413519cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Flow 'volume_create_manager' (e9218ec2-040b-4496-9a90-95186cce26f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c60f88b3-c0f4-49ba-8208-129c391eedad tempest-VolumesSnapshotTestJSON-2086043237 None] Created volume successfully.
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Acquiring lock "cinder-quobyte-0f7a985e-b9b3-4677-8fe2-ca36a6acf781" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Lock "cinder-quobyte-0f7a985e-b9b3-4677-8fe2-ca36a6acf781" acquired by "delete_volume" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:31 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9170b26-c150-4a86-9019-72cf95703ec0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:31 devstack sudo[99922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD
Sep 29 18:26:31 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:31 devstack sudo[99924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781
Sep 29 18:26:31 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:31 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:31 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb was qcow2, converting to qcow2 {{(pid=86821) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 18:26:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:31 devstack sudo[99929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1
Sep 29 18:26:31 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:31 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781" returned: 0 in 0.435s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:31 devstack sudo[99934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781
Sep 29 18:26:31 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:31 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0f7a985e-b9b3-4677-8fe2-ca36a6acf781" returned: 0 in 0.364s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Lock "cinder-quobyte-0f7a985e-b9b3-4677-8fe2-ca36a6acf781" released by "delete_volume" :: held 0.940s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Created reservations ['3bedb1d2-d960-475f-b8d5-e1cb7fbbb60f'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Created reservations ['70cd2354-ccb1-49ac-a8f2-15ec142f8646', 'f681600d-57bf-440b-9077-35a3772d9859', '6b0f08de-66b6-441c-a35b-52d1eeb4e519', '98821588-fddf-49e7-91b0-5dab5c073c71'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] Creating offline snapshot ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 of volume e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f47c4da-ca8c-4890-a410-8fa6844a3476]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:32 devstack sudo[99944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:26:32 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:32 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6
Sep 29 18:26:32 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:32 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.335s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:26:32 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-411daa12-6de5-4ba0-9c2f-7421a7330d71 tempest-GroupsV314Test-558734456 None] Delete group completed successfully.
Sep 29 18:26:32 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6" returned: 0 in 0.589s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:32 devstack sudo[99953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 1G
Sep 29 18:26:32 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:33 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 1G" returned: 0 in 0.547s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:33 devstack sudo[99958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86
Sep 29 18:26:33 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:33 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86" returned: 0 in 0.381s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:33 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 is being set with open permissions: ugo+rw
Sep 29 18:26:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:33 devstack sudo[99964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86
Sep 29 18:26:33 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:34 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1" returned: 0 in 2.809s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_lwg4g49ldevstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:26:34 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Converted 112.00 MB image at 39.84 MB/s
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:34 devstack sudo[99966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 1G
Sep 29 18:26:34 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:34 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86" returned: 0 in 0.365s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:34 devstack sudo[99969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.info
Sep 29 18:26:34 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:34 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.info" returned: 0 in 0.303s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:34 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.info is being set with open permissions: ugo+rw
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:34 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 1G" returned: 0 in 0.525s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Downloaded image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb ((None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}])) to volume b7214be5-e814-42b1-bc56-e746bbb1abb1 successfully. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 18:26:34 devstack sudo[99976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.info
Sep 29 18:26:34 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Temporary image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb for user cc73f03158a9417e8dd8ee9e5b0e9a5b is deleted. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Marking volume b7214be5-e814-42b1-bc56-e746bbb1abb1 as bootable. {{(pid=86821) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Copying metadata from image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb to b7214be5-e814-42b1-bc56-e746bbb1abb1. {{(pid=86821) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Creating volume glance metadata for volume b7214be5-e814-42b1-bc56-e746bbb1abb1 backed by image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86821) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15d6900-173d-49be-8e96-b03cfaca27de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7214be5-e814-42b1-bc56-e746bbb1abb1', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b96e5bb60>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9eef88-1665-489b-b8a4-1145daf1d755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:34 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Volume volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 (b7214be5-e814-42b1-bc56-e746bbb1abb1): created successfully
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9eef88-1665-489b-b8a4-1145daf1d755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Flow 'volume_create_manager' (5b2e7774-2aab-4a9c-b5b2-22f0af82654d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:34 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-36a62205-838e-4e0d-bc44-02fa2ae5fc8d tempest-VolumesImageMetadata-1270782116 None] Created volume successfully.
Sep 29 18:26:34 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.info" returned: 0 in 0.382s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:35 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fad481c6-32cd-49b9-8d1e-80fcbf390475 tempest-VolumesSnapshotTestJSON-2086043237 None] Create snapshot completed successfully
Sep 29 18:26:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-ca0f72dc-f68f-457b-b450-6c4e7ba9fd86-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-ca0f72dc-f68f-457b-b450-6c4e7ba9fd86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-ca0f72dc-f68f-457b-b450-6c4e7ba9fd86" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-ca0f72dc-f68f-457b-b450-6c4e7ba9fd86" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:35 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Deleting offline snapshot ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 of volume e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:26:35 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] snapshot_file for this snap is: volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:26:35 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a0b2f8-7be7-42d5-b7b9-d2634bf09bd8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:35 devstack sudo[99979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86
Sep 29 18:26:35 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Acquiring lock "cinder-b7214be5-e814-42b1-bc56-e746bbb1abb1-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Lock "cinder-b7214be5-e814-42b1-bc56-e746bbb1abb1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Acquiring lock "cinder-quobyte-b7214be5-e814-42b1-bc56-e746bbb1abb1" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Lock "cinder-quobyte-b7214be5-e814-42b1-bc56-e746bbb1abb1" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f5395f-ac83-4ae8-be0b-93dd23b88b1a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:36 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86" returned: 0 in 0.581s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0168f2-9509-40d5-9ef3-d4aebf7bfa69]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:36 devstack sudo[99984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1
Sep 29 18:26:36 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:36 devstack sudo[99985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6
Sep 29 18:26:36 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:36 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1" returned: 0 in 0.450s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:36 devstack sudo[99992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1
Sep 29 18:26:36 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:36 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6" returned: 0 in 0.504s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:36 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86
Sep 29 18:26:36 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:37 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b7214be5-e814-42b1-bc56-e746bbb1abb1" returned: 0 in 0.369s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Lock "cinder-quobyte-b7214be5-e814-42b1-bc56-e746bbb1abb1" released by "delete_volume" :: held 0.884s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Created reservations ['dc6df9e7-7fc3-42f2-8a39-92185fb79bbb', 'c86f1419-8ad2-4820-aa1c-47bb95af4464', '49da3d7d-1cf6-48d1-bcb2-4672a64ca5df', 'a4bc76b1-5c2b-423b-ba42-b0e1ad94a74f'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:37 devstack sudo[100004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:26:37 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:37 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86" returned: 0 in 0.562s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:37 devstack sudo[100006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86
Sep 29 18:26:37 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:37 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.407s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:26:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Deleted volume successfully.
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3b1242c8-e4bf-41b4-875f-9192999556b1 tempest-VolumesImageMetadata-1270782116 None] Lock "cinder-b7214be5-e814-42b1-bc56-e746bbb1abb1-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:37 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6.ca0f72dc-f68f-457b-b450-6c4e7ba9fd86" returned: 0 in 0.351s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-ca0f72dc-f68f-457b-b450-6c4e7ba9fd86" released by "_delete_snapshot" :: held 2.172s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6" released by "delete_snapshot" :: held 2.200s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:38 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Created reservations ['3be43550-97c4-4da3-997c-f9f1f0d4161f', '4ec88eaa-4ae8-494d-832f-ab794b094bae', '657aa855-1c1b-4ab3-893e-8580ebd85d79', '68011624-503d-4ae5-98c9-c0eecc7ab383'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:26:38 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Delete snapshot completed successfully.
Sep 29 18:26:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0515b115-f0cf-4f8b-92e5-5b0f4a5864f0 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-ca0f72dc-f68f-457b-b450-6c4e7ba9fd86-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Flow 'volume_create_manager' (6b6724a3-c9ec-4e51-8fa0-5a52b9d618d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480fabb7-d4da-43b0-8c31-67b49c8eb562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480fabb7-d4da-43b0-8c31-67b49c8eb562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1260845762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d1744e-5c74-42cc-9d37-844a2a6c4284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec21f922212d4f40aaacb8e9c147106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:40Z,use_quota=True,user_id='a4badf97f3184377a050a4a826e889b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ab1b44-16b7-4ed5-a7fd-233a46593564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ab1b44-16b7-4ed5-a7fd-233a46593564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7860e185-958c-4fdc-9514-efe1efce14f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7860e185-958c-4fdc-9514-efe1efce14f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d1744e-5c74-42cc-9d37-844a2a6c4284', 'volume_name': 'volume-99d1744e-5c74-42cc-9d37-844a2a6c4284', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d833c38-b98f-4df9-b421-1b40aed37a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d833c38-b98f-4df9-b421-1b40aed37a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1111e17-4aed-482d-9df0-a53fd5b52650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:39 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Volume 99d1744e-5c74-42cc-9d37-844a2a6c4284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d1744e-5c74-42cc-9d37-844a2a6c4284', 'volume_size': 1}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1260845762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d1744e-5c74-42cc-9d37-844a2a6c4284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec21f922212d4f40aaacb8e9c147106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:40Z,use_quota=True,user_id='a4badf97f3184377a050a4a826e889b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Creating volume 99d1744e-5c74-42cc-9d37-844a2a6c4284 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:26:39 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:26:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:39 devstack sudo[100011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 1073741824
Sep 29 18:26:39 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Flow 'volume_create_manager' (c9db4ab3-761e-4332-ad5a-be3a19cf6d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f907e4ac-fe27-462c-962a-50e1e0db9d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f907e4ac-fe27-462c-962a-50e1e0db9d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-46881786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083611b1-abd3-4329-82b8-d4bc0c352b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28161edc163d40bda5a13f28db4b7e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:40Z,use_quota=True,user_id='ce1979b8b51849fb97104c239ecee529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:40 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15280032-18f8-401f-b84e-d533b48af1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15280032-18f8-401f-b84e-d533b48af1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5f0502-0a8e-4d29-aa8b-deb1bc5aad5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5f0502-0a8e-4d29-aa8b-deb1bc5aad5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083611b1-abd3-4329-82b8-d4bc0c352b32', 'volume_name': 'volume-083611b1-abd3-4329-82b8-d4bc0c352b32', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5308cd-780b-4c00-9ae8-b77fa2bb13cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5308cd-780b-4c00-9ae8-b77fa2bb13cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca25d865-2ca1-415c-a694-47be6fbde2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:40 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Volume 083611b1-abd3-4329-82b8-d4bc0c352b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083611b1-abd3-4329-82b8-d4bc0c352b32', 'volume_size': 1}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 1073741824" returned: 0 in 0.822s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:40 devstack sudo[100017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284
Sep 29 18:26:40 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:41 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284" returned: 0 in 0.328s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-46881786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083611b1-abd3-4329-82b8-d4bc0c352b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28161edc163d40bda5a13f28db4b7e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:40Z,use_quota=True,user_id='ce1979b8b51849fb97104c239ecee529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Creating volume 083611b1-abd3-4329-82b8-d4bc0c352b32 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:26:41 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1111e17-4aed-482d-9df0-a53fd5b52650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d1744e-5c74-42cc-9d37-844a2a6c4284', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:41 devstack sudo[100020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 1073741824
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444e9ad4-ddcf-4742-a99d-22ea85ff81cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:41 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:41 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Volume volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 (99d1744e-5c74-42cc-9d37-844a2a6c4284): created successfully
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444e9ad4-ddcf-4742-a99d-22ea85ff81cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Flow 'volume_create_manager' (6b6724a3-c9ec-4e51-8fa0-5a52b9d618d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:41 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e3b21368-aef5-4a4a-98e6-e5d4e6acf7d6 tempest-VolumesSnapshotTestJSON-2086043237 None] Created volume successfully.
Sep 29 18:26:41 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 1073741824" returned: 0 in 0.538s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:41 devstack sudo[100026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32
Sep 29 18:26:41 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:42 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32" returned: 0 in 0.456s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca25d865-2ca1-415c-a694-47be6fbde2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083611b1-abd3-4329-82b8-d4bc0c352b32', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683a19d6-278a-4893-b096-32e65255f0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:42 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Volume volume-083611b1-abd3-4329-82b8-d4bc0c352b32 (083611b1-abd3-4329-82b8-d4bc0c352b32): created successfully
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683a19d6-278a-4893-b096-32e65255f0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Flow 'volume_create_manager' (c9db4ab3-761e-4332-ad5a-be3a19cf6d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-915230dd-6123-42b6-87a0-dd1de5fbef6c tempest-TestStampPattern-349576765 None] Created volume successfully.
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] Creating offline snapshot 08753cde-68dc-40af-a7ef-f140c2effaf2 of volume 99d1744e-5c74-42cc-9d37-844a2a6c4284 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d636e04b-e405-4a2e-8479-1c09f674acc5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:42 devstack sudo[100032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284
Sep 29 18:26:42 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:42 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284" returned: 0 in 0.440s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:42 devstack sudo[100037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2 1G
Sep 29 18:26:42 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:43 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2 1G" returned: 0 in 0.552s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:43 devstack sudo[100044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2
Sep 29 18:26:43 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:43 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2" returned: 0 in 0.374s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:43 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2 is being set with open permissions: ugo+rw
Sep 29 18:26:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:43 devstack sudo[100050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2
Sep 29 18:26:43 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:43 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2" returned: 0 in 0.318s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:44 devstack sudo[100053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.info
Sep 29 18:26:44 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:44 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.info" returned: 0 in 0.415s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:44 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.info is being set with open permissions: ugo+rw
Sep 29 18:26:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:44 devstack sudo[100060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.info
Sep 29 18:26:44 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:44 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.info" returned: 0 in 0.490s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.811s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-33b29cb2-58b2-4d54-8656-bb4cd355dcce tempest-VolumesSnapshotTestJSON-2086043237 None] Create snapshot completed successfully
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Flow 'volume_create_manager' (c1688c9d-1704-42aa-9f93-e60d4789eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485f1b91-3c6e-4e0a-a7d1-d68f7d7919a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485f1b91-3c6e-4e0a-a7d1-d68f7d7919a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-548018122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983861982d6e4e2ba3b4c4605d17bc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:45Z,use_quota=True,user_id='53ff76d80a8d44189b99be03aac2262a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84140d81-9551-4e22-b7a8-9c052b079671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84140d81-9551-4e22-b7a8-9c052b079671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d854df-b9e3-48d6-aecd-0a7320840767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d854df-b9e3-48d6-aecd-0a7320840767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1638250-71c2-4ba9-9a3d-6e5d3a56bdc8', 'volume_name': 'volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8', 'volume_size': 2}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0b8964-7d04-459c-b500-97e4d3725e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0b8964-7d04-459c-b500-97e4d3725e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b20095-0d08-4e27-be16-a8a73aea83bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:45 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Volume d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8', 'volume_size': 2}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-548018122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983861982d6e4e2ba3b4c4605d17bc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:45Z,use_quota=True,user_id='53ff76d80a8d44189b99be03aac2262a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Creating volume d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:26:45 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 2147483648 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:45 devstack sudo[100076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 2147483648
Sep 29 18:26:45 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:45 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 2147483648" returned: 0 in 0.732s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:46 devstack sudo[100082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8
Sep 29 18:26:46 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:46 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8" returned: 0 in 0.397s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b20095-0d08-4e27-be16-a8a73aea83bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8', 'volume_size': 2}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba20eb5-21f1-4d72-8089-134c897b12bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:26:46 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Volume volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 (d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8): created successfully
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba20eb5-21f1-4d72-8089-134c897b12bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Flow 'volume_create_manager' (c1688c9d-1704-42aa-9f93-e60d4789eada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Flow 'volume_create_manager' (e25e70a0-74ad-4638-bd5b-42eb59def280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d2fc78-9da2-44b6-9713-e50afb352bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2137e136-6d05-4940-8b1d-e4f95605d071 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Created volume successfully.
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d2fc78-9da2-44b6-9713-e50afb352bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1229257285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d90c4f-73cf-422b-826a-eaff684d7320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec21f922212d4f40aaacb8e9c147106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=08753cde-68dc-40af-a7ef-f140c2effaf2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:46Z,use_quota=True,user_id='a4badf97f3184377a050a4a826e889b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e7c6d6-dbc0-4a2c-a418-3b75b4134c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e7c6d6-dbc0-4a2c-a418-3b75b4134c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af35f2ab-96df-4a5f-af0d-73d9fdd2a2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af35f2ab-96df-4a5f-af0d-73d9fdd2a2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '11d90c4f-73cf-422b-826a-eaff684d7320', 'volume_name': 'volume-11d90c4f-73cf-422b-826a-eaff684d7320', 'volume_size': 2, 'snapshot_id': '08753cde-68dc-40af-a7ef-f140c2effaf2'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3c7afc-c9bc-46d6-ad75-c2347edfa0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3c7afc-c9bc-46d6-ad75-c2347edfa0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a368c474-1733-4c4a-ad55-7256a32ae079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:46 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Volume 11d90c4f-73cf-422b-826a-eaff684d7320: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-11d90c4f-73cf-422b-826a-eaff684d7320', 'volume_size': 2, 'snapshot_id': '08753cde-68dc-40af-a7ef-f140c2effaf2'}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-08753cde-68dc-40af-a7ef-f140c2effaf2-11d90c4f-73cf-422b-826a-eaff684d7320" by "_create_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-08753cde-68dc-40af-a7ef-f140c2effaf2-11d90c4f-73cf-422b-826a-eaff684d7320" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Creating volume 11d90c4f-73cf-422b-826a-eaff684d7320 from snapshot 08753cde-68dc-40af-a7ef-f140c2effaf2 {{(pid=86821) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-11d90c4f-73cf-422b-826a-eaff684d7320" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-11d90c4f-73cf-422b-826a-eaff684d7320" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] snapshot: 08753cde-68dc-40af-a7ef-f140c2effaf2, volume: 11d90c4f-73cf-422b-826a-eaff684d7320,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[606cd81a-3a82-4f12-a4c1-a2a633c44b86]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:46 devstack sudo[100086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2
Sep 29 18:26:46 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:47 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2" returned: 0 in 0.605s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99d1744e-5c74-42cc-9d37-844a2a6c4284(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:26:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c476cf-a00f-4ec8-8e26-24a8fdedc418]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:47 devstack sudo[100091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284
Sep 29 18:26:47 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:48 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284" returned: 0 in 0.913s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:26:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:26:48 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320 not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:26:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:48 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320
Sep 29 18:26:48 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:26:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:26:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:26:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:26:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:54 devstack sudo[100193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:26:54 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:55 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.745s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:55 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:26:55 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:26:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:26:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:26:56 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=71,cinder:UPDATE=59,cinder:INSERT=21,cinder:DELETE=3 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:26:57 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=59,cinder:SELECT=52,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:26:58 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320" returned: 0 in 10.562s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:58 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284, size 1024.00 MB, duration 10.56 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320 {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:26:58 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Converted 1024.00 MB image at 96.94 MB/s
Sep 29 18:26:58 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320 is being set with open permissions: ugo+rw
Sep 29 18:26:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:58 devstack sudo[100196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320
Sep 29 18:26:58 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:59 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320" returned: 0 in 0.422s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-11d90c4f-73cf-422b-826a-eaff684d7320" released by "_copy_volume_from_snapshot" :: held 12.645s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-08753cde-68dc-40af-a7ef-f140c2effaf2-11d90c4f-73cf-422b-826a-eaff684d7320" released by "_create_volume_from_snapshot" :: held 12.750s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.771s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.878s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Creating offline snapshot abbfc486-7a0a-4918-8729-4faa3ea78cdf of volume d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a368c474-1733-4c4a-ad55-7256a32ae079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d90c4f-73cf-422b-826a-eaff684d7320', 'volume_size': 2, 'snapshot_id': '08753cde-68dc-40af-a7ef-f140c2effaf2'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd26397-ffad-4d26-b705-aabe03d1a58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6420efa8-0e04-4ceb-80e0-2c83f4a5cd02]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:26:59 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Volume volume-11d90c4f-73cf-422b-826a-eaff684d7320 (11d90c4f-73cf-422b-826a-eaff684d7320): created successfully
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd26397-ffad-4d26-b705-aabe03d1a58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Flow 'volume_create_manager' (e25e70a0-74ad-4638-bd5b-42eb59def280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:26:59 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-22f19c8a-5fcf-4abc-9f16-50e84881a1a3 tempest-VolumesSnapshotTestJSON-2086043237 None] Created volume successfully.
Sep 29 18:26:59 devstack sudo[100200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8
Sep 29 18:26:59 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:26:59 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8" returned: 0 in 0.558s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:26:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf 2G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:00 devstack sudo[100206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf 2G
Sep 29 18:27:00 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-11d90c4f-73cf-422b-826a-eaff684d7320-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-11d90c4f-73cf-422b-826a-eaff684d7320-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-11d90c4f-73cf-422b-826a-eaff684d7320" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-11d90c4f-73cf-422b-826a-eaff684d7320" acquired by "delete_volume" :: waited 0.042s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:00 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c0ef32-2e04-4a1b-b40b-e31c44ad1d91]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:00 devstack sudo[100210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320
Sep 29 18:27:00 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:00 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf 2G" returned: 0 in 0.754s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:00 devstack sudo[100213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf
Sep 29 18:27:00 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:01 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320" returned: 0 in 0.598s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:01 devstack sudo[100218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320
Sep 29 18:27:01 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:01 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf" returned: 0 in 0.516s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:01 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf is being set with open permissions: ugo+rw
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:01 devstack sudo[100223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf
Sep 29 18:27:01 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:01 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-11d90c4f-73cf-422b-826a-eaff684d7320" returned: 0 in 0.511s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-11d90c4f-73cf-422b-826a-eaff684d7320" released by "delete_volume" :: held 1.204s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:01 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf" returned: 0 in 0.396s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Created reservations ['2c323336-fc47-4462-9163-f48ca8b1ab98', '1225c235-e599-4c32-843f-1fb909431095', '5e1d0ddc-44a2-460b-abd7-533899492c4e', 'dc1b2318-28b5-453d-b526-2b0e0f7cd038'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:01 devstack sudo[100227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.info
Sep 29 18:27:01 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:01 devstack sudo[100229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:27:01 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:02 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.info" returned: 0 in 0.349s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:02 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.info is being set with open permissions: ugo+rw
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:02 devstack sudo[100232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.info
Sep 29 18:27:02 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:02 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.316s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:27:02 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Deleted volume successfully.
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-218d0281-399b-459a-b879-b7bba0572c1e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-11d90c4f-73cf-422b-826a-eaff684d7320-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:02 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.info" returned: 0 in 0.318s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.031s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:02 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-9cc7aac1-40c6-4b45-949e-63b6bc764f61 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Create snapshot completed successfully
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Acquiring lock "cinder-abbfc486-7a0a-4918-8729-4faa3ea78cdf-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "cinder-abbfc486-7a0a-4918-8729-4faa3ea78cdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Acquiring lock "cinder-quobyte-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-08753cde-68dc-40af-a7ef-f140c2effaf2-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "cinder-quobyte-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8" acquired by "delete_snapshot" :: waited 0.068s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Acquiring lock "cinder-quobyte-abbfc486-7a0a-4918-8729-4faa3ea78cdf" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-08753cde-68dc-40af-a7ef-f140c2effaf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-99d1744e-5c74-42cc-9d37-844a2a6c4284" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "cinder-quobyte-abbfc486-7a0a-4918-8729-4faa3ea78cdf" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Deleting offline snapshot abbfc486-7a0a-4918-8729-4faa3ea78cdf of volume d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] snapshot_file for this snap is: volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-99d1744e-5c74-42cc-9d37-844a2a6c4284" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-08753cde-68dc-40af-a7ef-f140c2effaf2" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03415c8-e562-4b38-9b89-8132e9cc199a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-08753cde-68dc-40af-a7ef-f140c2effaf2" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Deleting offline snapshot 08753cde-68dc-40af-a7ef-f140c2effaf2 of volume 99d1744e-5c74-42cc-9d37-844a2a6c4284 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] snapshot_file for this snap is: volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de038cb-6eb6-46fd-93ea-d2ecb7be2f9b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:03 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf
Sep 29 18:27:03 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:03 devstack sudo[100238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2
Sep 29 18:27:03 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:03 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf" returned: 0 in 0.449s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:27:03 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[166a4377-590b-4495-8ced-b802bf27d710]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:03 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2" returned: 0 in 0.504s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99d1744e-5c74-42cc-9d37-844a2a6c4284(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:27:03 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a29c26d-bfbc-4b28-8c14-1772d2e34fb3]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:03 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8
Sep 29 18:27:03 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:03 devstack sudo[100249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284
Sep 29 18:27:03 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:03 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8" returned: 0 in 0.530s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:03 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf
Sep 29 18:27:03 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:04 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284" returned: 0 in 0.783s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:04 devstack sudo[100265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2
Sep 29 18:27:04 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:04 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf" returned: 0 in 0.450s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:04 devstack sudo[100267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf
Sep 29 18:27:04 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:04 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2" returned: 0 in 0.410s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:04 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8.abbfc486-7a0a-4918-8729-4faa3ea78cdf" returned: 0 in 0.378s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:04 devstack sudo[100275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2
Sep 29 18:27:04 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "cinder-quobyte-abbfc486-7a0a-4918-8729-4faa3ea78cdf" released by "_delete_snapshot" :: held 1.980s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "cinder-quobyte-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8" released by "delete_snapshot" :: held 2.031s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:05 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Created reservations ['15ab9fd4-670c-49d8-905d-842481fe99e0', '5432122a-fd88-4100-9d52-e18fbe45a05b', 'fd83ac4a-3c62-47e4-bb09-55e6e7fbebb4', 'a2153dc5-8712-43ad-8585-2113ea2b6b20'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Delete snapshot completed successfully.
Sep 29 18:27:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e1ede142-f9b4-4df5-9105-160776f3c3f3 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "cinder-abbfc486-7a0a-4918-8729-4faa3ea78cdf-delete_snapshot" released by "delete_snapshot" :: held 2.404s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:05 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284.08753cde-68dc-40af-a7ef-f140c2effaf2" returned: 0 in 0.421s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-08753cde-68dc-40af-a7ef-f140c2effaf2" released by "_delete_snapshot" :: held 2.291s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-99d1744e-5c74-42cc-9d37-844a2a6c4284" released by "delete_snapshot" :: held 2.348s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:05 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Created reservations ['ae589aa8-980e-41f4-a2e8-59af9f6ef140', 'd345ed89-61fe-4811-93a9-f22932bf8e27', '94683a79-08aa-4fd8-a44c-c0fd06625385', '0d0ecd16-5d5e-48d6-9293-0e87a5f43e86'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Delete snapshot completed successfully.
Sep 29 18:27:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bd8cb397-cd66-4bba-9056-ffcc3fb63f40 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-08753cde-68dc-40af-a7ef-f140c2effaf2-delete_snapshot" released by "delete_snapshot" :: held 2.575s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Acquiring lock "cinder-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-99d1744e-5c74-42cc-9d37-844a2a6c4284-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "cinder-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-99d1744e-5c74-42cc-9d37-844a2a6c4284-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Acquiring lock "cinder-quobyte-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-99d1744e-5c74-42cc-9d37-844a2a6c4284" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "cinder-quobyte-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8" acquired by "delete_volume" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-99d1744e-5c74-42cc-9d37-844a2a6c4284" acquired by "delete_volume" :: waited 0.053s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cf8326-14c0-4e6f-be54-413a2373006e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d556200d-9c17-4777-9994-1ef2b70e37c0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:06 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8
Sep 29 18:27:06 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:06 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284
Sep 29 18:27:06 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:06 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:06 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8" returned: 0 in 0.432s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284" returned: 0 in 0.424s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:06 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8
Sep 29 18:27:06 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:06 devstack sudo[100316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284
Sep 29 18:27:06 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:07 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:07 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8" returned: 0 in 0.282s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-99d1744e-5c74-42cc-9d37-844a2a6c4284" returned: 0 in 0.289s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "cinder-quobyte-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8" released by "delete_volume" :: held 0.830s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-99d1744e-5c74-42cc-9d37-844a2a6c4284" released by "delete_volume" :: held 0.795s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Created reservations ['63dea803-5943-4fa2-97e9-32e5d83f1bfa', '4ca17b3f-b3b3-48da-9f63-e2c56683c24c', '97920479-1b36-4a16-ba1e-0ea8651be00e', 'e710486f-a3dc-4c81-aa27-ea2a4626b6fe'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Created reservations ['20842eec-ee3e-40ff-96c1-1125fb2f3f74', '469f19e8-10c1-430b-a412-8118bb73c467', '8847c7fa-e0ff-492a-be44-c0394a1a132c', 'a592ed08-e11d-455a-b6fa-3e18a9312116'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:07 devstack sudo[100321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:27:07 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:07 devstack sudo[100323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:27:07 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:07 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.353s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:27:07 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Deleted volume successfully.
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6371adcc-eb45-40c0-9982-22f0343ef825 tempest-VolumesSnapshotNegativeTestJSON-1988119020 None] Lock "cinder-d1638250-71c2-4ba9-9a3d-6e5d3a56bdc8-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:07 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.420s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:27:07 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Deleted volume successfully.
Sep 29 18:27:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba7c1dc3-6071-4be8-98f8-2106331613f7 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-99d1744e-5c74-42cc-9d37-844a2a6c4284-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Flow 'volume_create_manager' (c47ad6c1-a856-4b28-bfe1-eda71478da59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad87801-f546-4707-b71a-bff670754a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad87801-f546-4707-b71a-bff670754a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1449017749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b053a7-43c0-45af-a88d-0317fab0d3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec21f922212d4f40aaacb8e9c147106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:08Z,use_quota=True,user_id='a4badf97f3184377a050a4a826e889b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a92ce39-b5db-4345-a55c-fa4972ac2a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a92ce39-b5db-4345-a55c-fa4972ac2a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f000091-dd76-4a7a-bb28-08a3734a8d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f000091-dd76-4a7a-bb28-08a3734a8d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b053a7-43c0-45af-a88d-0317fab0d3f1', 'volume_name': 'volume-13b053a7-43c0-45af-a88d-0317fab0d3f1', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcedcc99-d666-4354-b6a2-2003c5da6e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcedcc99-d666-4354-b6a2-2003c5da6e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d997d4-537e-468e-9949-49135b5a9276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:08 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Volume 13b053a7-43c0-45af-a88d-0317fab0d3f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b053a7-43c0-45af-a88d-0317fab0d3f1', 'volume_size': 1}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1449017749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b053a7-43c0-45af-a88d-0317fab0d3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec21f922212d4f40aaacb8e9c147106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:08Z,use_quota=True,user_id='a4badf97f3184377a050a4a826e889b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Creating volume 13b053a7-43c0-45af-a88d-0317fab0d3f1 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:27:08 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:08 devstack sudo[100327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 1073741824
Sep 29 18:27:08 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:08 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 1073741824" returned: 0 in 0.573s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:08 devstack sudo[100333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1
Sep 29 18:27:08 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Flow 'volume_create_manager' (227941dd-62ee-4109-8bf3-ad4806c8cf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd24c94-2450-4d66-bcab-fc0dc1917012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd24c94-2450-4d66-bcab-fc0dc1917012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2106658196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118655d6-a341-42f9-bc8a-305bb97d243b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5add1ba38442d180443b94deebecf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:09Z,use_quota=True,user_id='cd1a11e29989425c8e2ebc9b8bee7de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4b00fe-574a-408c-b3b9-aa130212a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4b00fe-574a-408c-b3b9-aa130212a56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55ba000-afee-421e-ab7c-be3bf08759e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55ba000-afee-421e-ab7c-be3bf08759e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '118655d6-a341-42f9-bc8a-305bb97d243b', 'volume_name': 'volume-118655d6-a341-42f9-bc8a-305bb97d243b', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ab8b08-ce9c-4486-83dd-92e04fb66fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ab8b08-ce9c-4486-83dd-92e04fb66fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75ca651-8f1a-450f-9c5d-cf80c1759295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:08 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Volume 118655d6-a341-42f9-bc8a-305bb97d243b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-118655d6-a341-42f9-bc8a-305bb97d243b', 'volume_size': 1}
Sep 29 18:27:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:09 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1" returned: 0 in 0.279s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.136s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2106658196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118655d6-a341-42f9-bc8a-305bb97d243b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5add1ba38442d180443b94deebecf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:09Z,use_quota=True,user_id='cd1a11e29989425c8e2ebc9b8bee7de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Creating volume 118655d6-a341-42f9-bc8a-305bb97d243b {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:27:09 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d997d4-537e-468e-9949-49135b5a9276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b053a7-43c0-45af-a88d-0317fab0d3f1', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:09 devstack sudo[100336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b 1073741824
Sep 29 18:27:09 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea8b322-ffb9-47e6-a446-f0aa21bbd6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:09 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Volume volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 (13b053a7-43c0-45af-a88d-0317fab0d3f1): created successfully
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea8b322-ffb9-47e6-a446-f0aa21bbd6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Flow 'volume_create_manager' (c47ad6c1-a856-4b28-bfe1-eda71478da59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:09 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6a112017-e71f-43eb-b32d-a3027276441e tempest-VolumesSnapshotTestJSON-2086043237 None] Created volume successfully.
Sep 29 18:27:09 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b 1073741824" returned: 0 in 0.480s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:09 devstack sudo[100342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b
Sep 29 18:27:09 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:09 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b" returned: 0 in 0.257s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75ca651-8f1a-450f-9c5d-cf80c1759295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118655d6-a341-42f9-bc8a-305bb97d243b', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b08cd57-93cf-4e08-8648-0ede76c8171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:09 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Volume volume-118655d6-a341-42f9-bc8a-305bb97d243b (118655d6-a341-42f9-bc8a-305bb97d243b): created successfully
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b08cd57-93cf-4e08-8648-0ede76c8171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Flow 'volume_create_manager' (227941dd-62ee-4109-8bf3-ad4806c8cf9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:09 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-02217cd2-4284-4d5f-b2d3-73c4c1253453 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Created volume successfully.
Sep 29 18:27:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] Creating offline snapshot 4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a of volume 13b053a7-43c0-45af-a88d-0317fab0d3f1 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:27:10 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[340a59ff-9eee-4204-a412-720a0cc6ec1e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:10 devstack sudo[100345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1
Sep 29 18:27:10 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:10 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Acquiring lock "cinder-118655d6-a341-42f9-bc8a-305bb97d243b-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1" returned: 0 in 0.496s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "cinder-118655d6-a341-42f9-bc8a-305bb97d243b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:10 devstack sudo[100350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a 1G
Sep 29 18:27:10 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Acquiring lock "cinder-quobyte-118655d6-a341-42f9-bc8a-305bb97d243b" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "cinder-quobyte-118655d6-a341-42f9-bc8a-305bb97d243b" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:11 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f00b8ea-203c-4442-9351-c01623a3758e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:11 devstack sudo[100352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b
Sep 29 18:27:11 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:11 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a 1G" returned: 0 in 0.629s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:11 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b" returned: 0 in 0.499s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:11 devstack sudo[100361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a
Sep 29 18:27:11 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:11 devstack sudo[100362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b
Sep 29 18:27:11 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:11 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-118655d6-a341-42f9-bc8a-305bb97d243b" returned: 0 in 0.312s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "cinder-quobyte-118655d6-a341-42f9-bc8a-305bb97d243b" released by "delete_volume" :: held 0.874s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:11 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a" returned: 0 in 0.415s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:11 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a is being set with open permissions: ugo+rw
Sep 29 18:27:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:11 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a
Sep 29 18:27:11 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:11 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Created reservations ['b9dcd652-0568-4d1c-ba7f-1f20de7867a9', 'deaeb8fb-1b48-4853-88d2-2ce9276ce792', '59cead52-476e-4cac-8b9b-3e8c1b730248', 'a7ce4b83-b0b3-4166-93d2-4071de3d6195'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:12 devstack sudo[100372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:27:12 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:12 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a" returned: 0 in 0.345s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:12 devstack sudo[100375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.info
Sep 29 18:27:12 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:12 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.352s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:27:12 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Deleted volume successfully.
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6b8d0040-1e24-4ce5-8407-12a1208b5279 tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "cinder-118655d6-a341-42f9-bc8a-305bb97d243b-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:12 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.info" returned: 0 in 0.343s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:12 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.info is being set with open permissions: ugo+rw
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:12 devstack sudo[100379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.info
Sep 29 18:27:12 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:12 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.info" returned: 0 in 0.283s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.634s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:13 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-b616504f-5ef8-4d32-86f0-f1193df9cd7b tempest-VolumesSnapshotTestJSON-2086043237 None] Create snapshot completed successfully
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Flow 'volume_create_manager' (838e6bd6-c9fe-401b-8f43-98bada2d61f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d9559e-c95a-4b5d-991d-cf7775daf545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d9559e-c95a-4b5d-991d-cf7775daf545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1643697298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728d6359-644d-4131-bf05-f724195f3600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5add1ba38442d180443b94deebecf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:14Z,use_quota=True,user_id='cd1a11e29989425c8e2ebc9b8bee7de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374c37eb-ebff-44a3-b25b-5cd3772587c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374c37eb-ebff-44a3-b25b-5cd3772587c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8e195a-f4f0-4f73-afe8-fd4b0cbc7ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8e195a-f4f0-4f73-afe8-fd4b0cbc7ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '728d6359-644d-4131-bf05-f724195f3600', 'volume_name': 'volume-728d6359-644d-4131-bf05-f724195f3600', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1a40fc-3ed7-4d85-8fe8-6d9ccfc1f82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1a40fc-3ed7-4d85-8fe8-6d9ccfc1f82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90094380-fff9-465a-b48e-5f74e036b3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:14 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Volume 728d6359-644d-4131-bf05-f724195f3600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-728d6359-644d-4131-bf05-f724195f3600', 'volume_size': 1}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1643697298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728d6359-644d-4131-bf05-f724195f3600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5add1ba38442d180443b94deebecf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:14Z,use_quota=True,user_id='cd1a11e29989425c8e2ebc9b8bee7de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Creating volume 728d6359-644d-4131-bf05-f724195f3600 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:27:14 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:14 devstack sudo[100391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600 1073741824
Sep 29 18:27:14 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Flow 'volume_create_manager' (4084f6e4-c3ea-47d5-b2e5-d336d89a1814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16842cf-cc40-47d3-9394-38bb87d1453b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16842cf-cc40-47d3-9394-38bb87d1453b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1450590347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81de8b46-8f68-46a2-8eb2-74502f510b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec21f922212d4f40aaacb8e9c147106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:14Z,use_quota=True,user_id='a4badf97f3184377a050a4a826e889b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd0ecdc-35bf-4472-84ad-aabbdeb584da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd0ecdc-35bf-4472-84ad-aabbdeb584da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6728b7-6871-45ed-953b-2619bbbd68f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6728b7-6871-45ed-953b-2619bbbd68f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '81de8b46-8f68-46a2-8eb2-74502f510b8b', 'volume_name': 'volume-81de8b46-8f68-46a2-8eb2-74502f510b8b', 'volume_size': 1, 'snapshot_id': '4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffd3368-9a0f-45cd-a08c-421ec07bcbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffd3368-9a0f-45cd-a08c-421ec07bcbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00251383-7dc6-4b77-8955-5527a7c14ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:14 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Volume 81de8b46-8f68-46a2-8eb2-74502f510b8b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-81de8b46-8f68-46a2-8eb2-74502f510b8b', 'volume_size': 1, 'snapshot_id': '4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a'}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:14 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600 1073741824" returned: 0 in 0.575s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:14 devstack sudo[100397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600
Sep 29 18:27:14 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:15 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600" returned: 0 in 0.287s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.422s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a-81de8b46-8f68-46a2-8eb2-74502f510b8b" by "_create_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90094380-fff9-465a-b48e-5f74e036b3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728d6359-644d-4131-bf05-f724195f3600', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bc0c4a-5a92-4cb8-801f-38aa33b15947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a-81de8b46-8f68-46a2-8eb2-74502f510b8b" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Creating volume 81de8b46-8f68-46a2-8eb2-74502f510b8b from snapshot 4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a {{(pid=86821) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-81de8b46-8f68-46a2-8eb2-74502f510b8b" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:15 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Volume volume-728d6359-644d-4131-bf05-f724195f3600 (728d6359-644d-4131-bf05-f724195f3600): created successfully
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bc0c4a-5a92-4cb8-801f-38aa33b15947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Flow 'volume_create_manager' (838e6bd6-c9fe-401b-8f43-98bada2d61f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-81de8b46-8f68-46a2-8eb2-74502f510b8b" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] snapshot: 4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a, volume: 81de8b46-8f68-46a2-8eb2-74502f510b8b,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:27:15 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d744b079-b9fe-4a79-82b3-3c341ac97ddd tempest-VolumeQuotasAdminTestJSON-1150753497 None] Created volume successfully.
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[04daf6d1-5ee0-42dd-85bb-9bba2fe2826b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:15 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a
Sep 29 18:27:15 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:15 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a" returned: 0 in 0.392s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b053a7-43c0-45af-a88d-0317fab0d3f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[09685c93-a6a8-402d-bae5-acb403564ba5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:15 devstack sudo[100405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1
Sep 29 18:27:15 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:16 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1" returned: 0 in 0.411s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:27:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:27:16 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:27:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:16 devstack sudo[100410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b
Sep 29 18:27:16 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:17 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5cff527f-8fee-4915-99ff-1e6927571587 tempest-VolumeQuotasAdminTestJSON-108909386 None] Transfer volume completed successfully.
Sep 29 18:27:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Acquiring lock "cinder-728d6359-644d-4131-bf05-f724195f3600-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Lock "cinder-728d6359-644d-4131-bf05-f724195f3600-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Acquiring lock "cinder-quobyte-728d6359-644d-4131-bf05-f724195f3600" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Lock "cinder-quobyte-728d6359-644d-4131-bf05-f724195f3600" acquired by "delete_volume" :: waited 0.040s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:19 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2484a145-a43d-4600-8083-7d266e532809]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:19 devstack sudo[100422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600
Sep 29 18:27:19 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:20 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600" returned: 0 in 1.060s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:20 devstack sudo[100432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600
Sep 29 18:27:20 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:20 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-728d6359-644d-4131-bf05-f724195f3600" returned: 0 in 0.608s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Lock "cinder-quobyte-728d6359-644d-4131-bf05-f724195f3600" released by "delete_volume" :: held 1.792s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:21 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Created reservations ['506e00df-dba6-497a-a25a-5d447105cda2', 'c6da9fe6-494e-480b-bf42-a3971f0f6b57', '461f8ec0-62b5-4864-8183-49a721240fe4', 'e6f43db4-2e5d-4602-a5b3-02505a86476f'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:21 devstack sudo[100439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:27:21 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:22 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.769s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:22 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:27:22 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Deleted volume successfully.
Sep 29 18:27:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-04cebed9-6baa-4c64-9deb-ad251a91593f tempest-VolumeQuotasAdminTestJSON-1096563538 None] Lock "cinder-728d6359-644d-4131-bf05-f724195f3600-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-7c19d7aa-9e06-4583-8fef-fc3deb1f5770 req-c6f2c23d-587e-497f-a71a-a8ca2f86d716 tempest-TestStampPattern-349576765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:26 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b" returned: 0 in 10.454s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:26 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1, size 1024.00 MB, duration 10.46 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:27:26 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Converted 1024.00 MB image at 97.94 MB/s
Sep 29 18:27:26 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b is being set with open permissions: ugo+rw
Sep 29 18:27:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:26 devstack sudo[100487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b
Sep 29 18:27:26 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:26 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b" returned: 0 in 0.330s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-81de8b46-8f68-46a2-8eb2-74502f510b8b" released by "_copy_volume_from_snapshot" :: held 11.696s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a-81de8b46-8f68-46a2-8eb2-74502f510b8b" released by "_create_volume_from_snapshot" :: held 11.815s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.857s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-7c19d7aa-9e06-4583-8fef-fc3deb1f5770 req-c6f2c23d-587e-497f-a71a-a8ca2f86d716 tempest-TestStampPattern-349576765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.531s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-7c19d7aa-9e06-4583-8fef-fc3deb1f5770 req-c6f2c23d-587e-497f-a71a-a8ca2f86d716 tempest-TestStampPattern-349576765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00251383-7dc6-4b77-8955-5527a7c14ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81de8b46-8f68-46a2-8eb2-74502f510b8b', 'volume_size': 1, 'snapshot_id': '4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d5e13a-0305-40ec-aa96-ac98469a9ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:27 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Volume volume-81de8b46-8f68-46a2-8eb2-74502f510b8b (81de8b46-8f68-46a2-8eb2-74502f510b8b): created successfully
Sep 29 18:27:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d5e13a-0305-40ec-aa96-ac98469a9ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Flow 'volume_create_manager' (4084f6e4-c3ea-47d5-b2e5-d336d89a1814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-7c19d7aa-9e06-4583-8fef-fc3deb1f5770 req-c6f2c23d-587e-497f-a71a-a8ca2f86d716 tempest-TestStampPattern-349576765 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-083611b1-abd3-4329-82b8-d4bc0c352b32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2898b568-4e02-4617-ad7b-064bd017a934', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:27:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-817d1014-5204-409a-86b4-7fe2eab64738 tempest-VolumesSnapshotTestJSON-2086043237 None] Created volume successfully.
Sep 29 18:27:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-7c19d7aa-9e06-4583-8fef-fc3deb1f5770 req-c6f2c23d-587e-497f-a71a-a8ca2f86d716 tempest-TestStampPattern-349576765 None] attachment_update completed successfully.
Sep 29 18:27:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-81de8b46-8f68-46a2-8eb2-74502f510b8b-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-81de8b46-8f68-46a2-8eb2-74502f510b8b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-81de8b46-8f68-46a2-8eb2-74502f510b8b" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-81de8b46-8f68-46a2-8eb2-74502f510b8b" acquired by "delete_volume" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:28 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae20b08a-6da9-409b-a328-da715125daed]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:28 devstack sudo[100908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b
Sep 29 18:27:28 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:29 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b" returned: 0 in 0.495s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:29 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b
Sep 29 18:27:29 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:29 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-81de8b46-8f68-46a2-8eb2-74502f510b8b" returned: 0 in 0.277s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-81de8b46-8f68-46a2-8eb2-74502f510b8b" released by "delete_volume" :: held 0.893s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Created reservations ['f70ccfcd-6ddf-442e-8cc3-866c5b139276', '8dca6f34-d150-47dd-83fe-20a65a259ead', 'd7275b3e-6aaf-42f6-bbe4-897cd50a2256', 'c8f41645-14af-4678-bf26-b8dbd2f80ff1'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:29 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:27:29 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.141s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:29 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-13b053a7-43c0-45af-a88d-0317fab0d3f1" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.467s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:27:29 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Deleted volume successfully.
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-13b053a7-43c0-45af-a88d-0317fab0d3f1" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Deleting offline snapshot 4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a of volume 13b053a7-43c0-45af-a88d-0317fab0d3f1 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:27:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] snapshot_file for this snap is: volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:27:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e5f6d016-028f-45ce-b4f9-325005933f2e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-81de8b46-8f68-46a2-8eb2-74502f510b8b-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:30 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64bc61b-923a-4a4e-882a-39ac24fe1075]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:30 devstack sudo[100929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a
Sep 29 18:27:30 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:30 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a" returned: 0 in 0.485s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b053a7-43c0-45af-a88d-0317fab0d3f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:27:30 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf55ced6-293c-416a-bc48-d770c2fd23ef]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:30 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1
Sep 29 18:27:30 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:31 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1" returned: 0 in 0.858s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:31 devstack sudo[100945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a
Sep 29 18:27:31 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:31 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a" returned: 0 in 0.455s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:31 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a
Sep 29 18:27:31 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:32 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1.4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a" returned: 0 in 0.323s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a" released by "_delete_snapshot" :: held 2.314s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-13b053a7-43c0-45af-a88d-0317fab0d3f1" released by "delete_snapshot" :: held 2.356s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:32 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Created reservations ['ac3a2f02-70c3-4151-82d1-4cf61e7d37a9', 'aec64d85-d9ab-493e-8831-b80e338cebd1', '13621e3f-5439-4356-98b6-f094794feb76', 'bcef90fd-17f4-4ee4-9b64-88e44834a4d2'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:32 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Delete snapshot completed successfully.
Sep 29 18:27:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e31698c6-e0f3-4a19-b093-8d260eee7559 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-4e7efed7-98fb-4d6a-a3d4-e91f79b4a45a-delete_snapshot" released by "delete_snapshot" :: held 2.611s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-13b053a7-43c0-45af-a88d-0317fab0d3f1-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-13b053a7-43c0-45af-a88d-0317fab0d3f1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-13b053a7-43c0-45af-a88d-0317fab0d3f1" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-13b053a7-43c0-45af-a88d-0317fab0d3f1" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:33 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6db8b9-586d-4329-8166-2f399f3d3cc6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:33 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-960ed906-11f4-4306-8ca2-e8362a965382 req-f50ef8c7-9287-4bf3-8fff-96544a8e4cf8 tempest-TestStampPattern-349576765 None] Terminate volume connection completed successfully.
Sep 29 18:27:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-960ed906-11f4-4306-8ca2-e8362a965382 req-f50ef8c7-9287-4bf3-8fff-96544a8e4cf8 tempest-TestStampPattern-349576765 None] Deleting attachment 2898b568-4e02-4617-ad7b-064bd017a934. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:27:33 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1
Sep 29 18:27:33 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:34 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1" returned: 0 in 0.663s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:34 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1
Sep 29 18:27:34 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] Creating offline snapshot 4a2ca47c-6fa2-459c-b928-6687d334eb3e of volume 083611b1-abd3-4329-82b8-d4bc0c352b32 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[344ab05a-f255-4ef2-afd8-cc4091a265bf]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:34 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-13b053a7-43c0-45af-a88d-0317fab0d3f1" returned: 0 in 0.360s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-13b053a7-43c0-45af-a88d-0317fab0d3f1" released by "delete_volume" :: held 1.137s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Created reservations ['097b4e24-ee40-46a5-9b94-3056a37950e8', '795d27b7-6fb4-4dfe-b071-fb4eb41aacbc', '5c169b4a-c799-4967-a476-5fecadd60a8f', '9fc6449f-4423-4426-a4d8-0665193624d8'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:34 devstack sudo[101005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32
Sep 29 18:27:34 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:34 devstack sudo[101007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:27:34 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:35 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32" returned: 0 in 0.665s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:35 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.458s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:27:35 devstack sudo[101013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e 1G
Sep 29 18:27:35 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Deleted volume successfully.
Sep 29 18:27:35 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2f42db2-f102-4a28-8028-e1f372e21cb1 tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-13b053a7-43c0-45af-a88d-0317fab0d3f1-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Flow 'volume_create_manager' (adad9413-d768-4eba-bd08-3a0e9b65eab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:35 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6aca94-e7f7-4654-b952-f0128e839f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e 1G" returned: 0 in 0.573s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083611b1-abd3-4329-82b8-d4bc0c352b32 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:35 devstack sudo[101019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083611b1-abd3-4329-82b8-d4bc0c352b32 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e
Sep 29 18:27:35 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6aca94-e7f7-4654-b952-f0128e839f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-104207362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=754aa321-67e1-457c-a5d6-881fbeac7d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990541b65f604623b5c937be8beafc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:36Z,use_quota=True,user_id='3cdb563a8a614267b014fbfb89c53dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84b68ed-ae7d-4793-b8bd-39ae112e8e0c),volume_type_id=d84b68ed-ae7d-4793-b8bd-39ae112e8e0c)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967092fd-9641-46d7-8bbe-77234fddc947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967092fd-9641-46d7-8bbe-77234fddc947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fa60e8-d28d-45ec-99c5-75b6c856dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fa60e8-d28d-45ec-99c5-75b6c856dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '754aa321-67e1-457c-a5d6-881fbeac7d09', 'volume_name': 'volume-754aa321-67e1-457c-a5d6-881fbeac7d09', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3caef2-d9f9-4f7d-b049-7d902515c70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3caef2-d9f9-4f7d-b049-7d902515c70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34aa58c7-1606-4f86-ac48-f479358a9338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:35 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Volume 754aa321-67e1-457c-a5d6-881fbeac7d09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-754aa321-67e1-457c-a5d6-881fbeac7d09', 'volume_size': 1}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "cinder-quobyte-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fef19b2-eca2-4b6d-a084-498441703d37]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:36 devstack sudo[101021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6
Sep 29 18:27:36 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:36 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083611b1-abd3-4329-82b8-d4bc0c352b32 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e" returned: 0 in 0.360s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:36 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e is being set with open permissions: ugo+rw
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:36 devstack sudo[101026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e
Sep 29 18:27:36 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:36 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6" returned: 0 in 0.457s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:36 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e" returned: 0 in 0.326s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:36 devstack sudo[101034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6
Sep 29 18:27:36 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:36 devstack sudo[101036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.info
Sep 29 18:27:36 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:36 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6" returned: 0 in 0.362s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-quobyte-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6" released by "delete_volume" :: held 0.904s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:36 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.info" returned: 0 in 0.425s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:36 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.info is being set with open permissions: ugo+rw
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Created reservations ['2b91d714-a0dc-4114-bab6-732b7288dcf3', 'cfd164f0-79b9-4cec-8a63-ab854c019d8b', '28b09a9e-2eae-4d02-b142-94b134bfea72', 'f0d05fc4-fa22-407e-a7b5-4f7b22ca45c0'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:36 devstack sudo[101040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.info
Sep 29 18:27:36 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:37 devstack sudo[101042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:27:37 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:37 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.info" returned: 0 in 0.466s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:37 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.979s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-104207362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=754aa321-67e1-457c-a5d6-881fbeac7d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990541b65f604623b5c937be8beafc8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:36Z,use_quota=True,user_id='3cdb563a8a614267b014fbfb89c53dd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d84b68ed-ae7d-4793-b8bd-39ae112e8e0c),volume_type_id=d84b68ed-ae7d-4793-b8bd-39ae112e8e0c)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Creating volume 754aa321-67e1-457c-a5d6-881fbeac7d09 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:27:37 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.400s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:27:37 devstack sudo[101046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09 1073741824
Sep 29 18:27:37 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Deleted volume successfully.
Sep 29 18:27:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e27fb55f-b63b-4d62-8756-36824f6922eb tempest-TestStampPattern-349576765 None] Create snapshot completed successfully
Sep 29 18:27:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d0dd00f-57b5-4a2a-acca-4297d76bcb8e tempest-VolumesSnapshotTestJSON-2086043237 None] Lock "cinder-e7d7aca7-03a0-4b2c-87eb-901db8dfd8d6-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:38 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09 1073741824" returned: 0 in 0.720s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:38 devstack sudo[101052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09
Sep 29 18:27:38 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:38 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09" returned: 0 in 0.341s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:27:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34aa58c7-1606-4f86-ac48-f479358a9338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-754aa321-67e1-457c-a5d6-881fbeac7d09', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a62d961-bab9-4df1-86f7-7bfd9a5fa4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:38 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Volume volume-754aa321-67e1-457c-a5d6-881fbeac7d09 (754aa321-67e1-457c-a5d6-881fbeac7d09): created successfully
Sep 29 18:27:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a62d961-bab9-4df1-86f7-7bfd9a5fa4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Flow 'volume_create_manager' (adad9413-d768-4eba-bd08-3a0e9b65eab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:38 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d0cf6893-0476-47da-8dd5-fca7d39f69fc tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Created volume successfully.
Sep 29 18:27:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8c63d7-4c9b-4749-9f60-d7eb398501f9 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8c63d7-4c9b-4749-9f60-d7eb398501f9 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6b8c63d7-4c9b-4749-9f60-d7eb398501f9 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6b8c63d7-4c9b-4749-9f60-d7eb398501f9 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8c63d7-4c9b-4749-9f60-d7eb398501f9 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8c63d7-4c9b-4749-9f60-d7eb398501f9 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:39 devstack sudo[101055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:27:39 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:39 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8c63d7-4c9b-4749-9f60-d7eb398501f9 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.376s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:39 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6b8c63d7-4c9b-4749-9f60-d7eb398501f9 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:27:39 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6b8c63d7-4c9b-4749-9f60-d7eb398501f9 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Retype volume completed successfully.
Sep 29 18:27:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Acquiring lock "cinder-754aa321-67e1-457c-a5d6-881fbeac7d09-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "cinder-754aa321-67e1-457c-a5d6-881fbeac7d09-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Acquiring lock "cinder-quobyte-754aa321-67e1-457c-a5d6-881fbeac7d09" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "cinder-quobyte-754aa321-67e1-457c-a5d6-881fbeac7d09" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:41 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01c0301-5845-4441-aa2d-530e20da48f7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:41 devstack sudo[101083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09
Sep 29 18:27:41 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:41 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09" returned: 0 in 0.504s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:41 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09
Sep 29 18:27:41 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:41 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-754aa321-67e1-457c-a5d6-881fbeac7d09" returned: 0 in 0.370s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "cinder-quobyte-754aa321-67e1-457c-a5d6-881fbeac7d09" released by "delete_volume" :: held 0.934s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:42 devstack cinder-volume[86821]: WARNING cinder.quota [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:27:42 devstack cinder-volume[86821]: WARNING cinder.quota [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:27:42 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Created reservations ['53292e85-740b-43da-bafd-e17e3d757dde', '993b5243-2bc9-4445-b26d-180d199b9694', '631e605d-45b1-4788-a7be-db9091e29d8e', '96bc443f-ffb5-41d7-af29-6a6f3b630d54'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:27:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:42 devstack sudo[101100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:27:42 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:42 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.424s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:42 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:27:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Deleted volume successfully.
Sep 29 18:27:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e6320d7-d176-4add-9284-b2df31392cb8 tempest-VolumeRetypeWithoutMigrationTest-121852270 None] Lock "cinder-754aa321-67e1-457c-a5d6-881fbeac7d09-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Flow 'volume_create_manager' (a6ec4360-ce10-46ff-ae6c-140dc98443a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8996f7-862b-4c75-82c6-c7a40efabe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8996f7-862b-4c75-82c6-c7a40efabe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1761825981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4abda08-7642-43bd-8fcb-7e32d234924c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28161edc163d40bda5a13f28db4b7e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4a2ca47c-6fa2-459c-b928-6687d334eb3e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:47Z,use_quota=True,user_id='ce1979b8b51849fb97104c239ecee529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96919ae9-90b5-43cf-9765-8dd82b7ebacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96919ae9-90b5-43cf-9765-8dd82b7ebacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b34530e-fd16-49d6-b12b-2c7bdf3e8c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b34530e-fd16-49d6-b12b-2c7bdf3e8c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a4abda08-7642-43bd-8fcb-7e32d234924c', 'volume_name': 'volume-a4abda08-7642-43bd-8fcb-7e32d234924c', 'volume_size': 1, 'snapshot_id': '4a2ca47c-6fa2-459c-b928-6687d334eb3e'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0b7cf1-867d-46c6-830a-a9d3d74a6e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0b7cf1-867d-46c6-830a-a9d3d74a6e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c228f85-67e7-412e-8c19-77ba002feb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:47 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Volume a4abda08-7642-43bd-8fcb-7e32d234924c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a4abda08-7642-43bd-8fcb-7e32d234924c', 'volume_size': 1, 'snapshot_id': '4a2ca47c-6fa2-459c-b928-6687d334eb3e'}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Acquiring lock "cinder-quobyte-4a2ca47c-6fa2-459c-b928-6687d334eb3e-a4abda08-7642-43bd-8fcb-7e32d234924c" by "_create_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-4a2ca47c-6fa2-459c-b928-6687d334eb3e-a4abda08-7642-43bd-8fcb-7e32d234924c" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Creating volume a4abda08-7642-43bd-8fcb-7e32d234924c from snapshot 4a2ca47c-6fa2-459c-b928-6687d334eb3e {{(pid=86821) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Acquiring lock "cinder-quobyte-a4abda08-7642-43bd-8fcb-7e32d234924c" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-a4abda08-7642-43bd-8fcb-7e32d234924c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] snapshot: 4a2ca47c-6fa2-459c-b928-6687d334eb3e, volume: a4abda08-7642-43bd-8fcb-7e32d234924c,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[79abd525-0d09-434d-8822-180f644c15ce]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:48 devstack sudo[101109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e
Sep 29 18:27:48 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:48 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e" returned: 0 in 0.562s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083611b1-abd3-4329-82b8-d4bc0c352b32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:27:48 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[838b01ec-ad91-4bdb-99c8-21236f083f46]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:27:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:48 devstack sudo[101115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32
Sep 29 18:27:48 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:49 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32" returned: 0 in 0.754s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:27:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:27:49 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:27:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:49 devstack sudo[101124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c
Sep 29 18:27:49 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:27:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:27:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:27:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:27:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:27:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:54 devstack sudo[101153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:27:54 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:27:55 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.796s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:55 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:27:55 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:27:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:27:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:27:57 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=107,cinder:UPDATE=102,cinder:INSERT=29,cinder:DELETE=10 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:27:57 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=97,cinder:INSERT=28,cinder:UPDATE=131,cinder:DELETE=8 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:27:57 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:27:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Flow 'volume_create_manager' (1fe95c42-962d-4f2f-8515-c41034489051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:27:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a40d861-deb4-4785-901e-0dbee52dceae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a40d861-deb4-4785-901e-0dbee52dceae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2142518843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3843d3ac-e07c-4702-a408-905a7e95bc9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38baf352aac64a7cbe46e098aed9c145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:58Z,use_quota=True,user_id='65ae51a56781495e89c51da6a5fd8470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(755cc7f3-6669-4f0f-988f-f555663563e2),volume_type_id=755cc7f3-6669-4f0f-988f-f555663563e2)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895629f4-0f23-44dd-82ab-2bec75ef02e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895629f4-0f23-44dd-82ab-2bec75ef02e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d268368-d964-43fe-b162-a244f854e894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d268368-d964-43fe-b162-a244f854e894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3843d3ac-e07c-4702-a408-905a7e95bc9f', 'volume_name': 'volume-3843d3ac-e07c-4702-a408-905a7e95bc9f', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e6e17e-d959-425a-bf44-4eb4c1953574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e6e17e-d959-425a-bf44-4eb4c1953574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:27:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3148649d-62b5-4ac2-b906-0fff7b2fef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:27:58 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Volume 3843d3ac-e07c-4702-a408-905a7e95bc9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3843d3ac-e07c-4702-a408-905a7e95bc9f', 'volume_size': 1}
Sep 29 18:27:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:27:59 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root
Sep 29 18:27:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c" returned: 0 in 10.635s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:27:59 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32, size 1024.00 MB, duration 10.64 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:27:59 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Converted 1024.00 MB image at 96.28 MB/s
Sep 29 18:27:59 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c is being set with open permissions: ugo+rw
Sep 29 18:27:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:27:59 devstack sudo[101182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c
Sep 29 18:27:59 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:00 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c" returned: 0 in 0.262s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-a4abda08-7642-43bd-8fcb-7e32d234924c" released by "_copy_volume_from_snapshot" :: held 12.392s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-4a2ca47c-6fa2-459c-b928-6687d334eb3e-a4abda08-7642-43bd-8fcb-7e32d234924c" released by "_create_volume_from_snapshot" :: held 12.500s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.531s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.098s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2142518843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3843d3ac-e07c-4702-a408-905a7e95bc9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38baf352aac64a7cbe46e098aed9c145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:58Z,use_quota=True,user_id='65ae51a56781495e89c51da6a5fd8470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(755cc7f3-6669-4f0f-988f-f555663563e2),volume_type_id=755cc7f3-6669-4f0f-988f-f555663563e2)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Creating volume 3843d3ac-e07c-4702-a408-905a7e95bc9f {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:28:00 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:00 devstack sudo[101185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f 1073741824
Sep 29 18:28:00 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c228f85-67e7-412e-8c19-77ba002feb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4abda08-7642-43bd-8fcb-7e32d234924c', 'volume_size': 1, 'snapshot_id': '4a2ca47c-6fa2-459c-b928-6687d334eb3e'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b417e92-1943-47ed-9577-ad15c50ebdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:00 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Volume volume-a4abda08-7642-43bd-8fcb-7e32d234924c (a4abda08-7642-43bd-8fcb-7e32d234924c): created successfully
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b417e92-1943-47ed-9577-ad15c50ebdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Flow 'volume_create_manager' (a6ec4360-ce10-46ff-ae6c-140dc98443a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:00 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fd38d7fa-c255-4fa9-a559-a26b6a7a6ddb tempest-TestStampPattern-349576765 None] Created volume successfully.
Sep 29 18:28:00 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f 1073741824" returned: 0 in 0.555s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:00 devstack sudo[101191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f
Sep 29 18:28:00 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:01 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f" returned: 0 in 0.301s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:28:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3148649d-62b5-4ac2-b906-0fff7b2fef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3843d3ac-e07c-4702-a408-905a7e95bc9f', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec20545-6e0e-4955-9bfd-2a8fc8d2b1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:01 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Volume volume-3843d3ac-e07c-4702-a408-905a7e95bc9f (3843d3ac-e07c-4702-a408-905a7e95bc9f): created successfully
Sep 29 18:28:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec20545-6e0e-4955-9bfd-2a8fc8d2b1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Flow 'volume_create_manager' (1fe95c42-962d-4f2f-8515-c41034489051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:01 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-4b81890e-87ba-4f54-a2eb-23e63677cabc tempest-VolumeTypesAccessTest-347477707 None] Created volume successfully.
Sep 29 18:28:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Acquiring lock "cinder-3843d3ac-e07c-4702-a408-905a7e95bc9f-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Lock "cinder-3843d3ac-e07c-4702-a408-905a7e95bc9f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Acquiring lock "cinder-quobyte-3843d3ac-e07c-4702-a408-905a7e95bc9f" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Lock "cinder-quobyte-3843d3ac-e07c-4702-a408-905a7e95bc9f" acquired by "delete_volume" :: waited 0.053s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:02 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0258461-7877-4bdc-83c4-7c6d2543a8af]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:02 devstack sudo[101209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f
Sep 29 18:28:02 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:03 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f" returned: 0 in 0.844s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:03 devstack sudo[101258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f
Sep 29 18:28:03 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:03 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3843d3ac-e07c-4702-a408-905a7e95bc9f" returned: 0 in 0.468s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Lock "cinder-quobyte-3843d3ac-e07c-4702-a408-905a7e95bc9f" released by "delete_volume" :: held 1.418s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:03 devstack cinder-volume[86821]: WARNING cinder.quota [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-856893380 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-856893380, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:28:03 devstack cinder-volume[86821]: WARNING cinder.quota [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-856893380 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-856893380, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:28:03 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Created reservations ['646f6d12-cbcf-4834-8ea3-15c19f058c8d', '11dadc20-d470-4b24-8618-00273427d5e4', '2ef67e90-2f89-4ded-8ded-620b4008ccee', 'bfc32b0b-2ea3-4772-a009-1734965a7ef5'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:28:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:04 devstack sudo[101287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:28:04 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:04 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.329s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:04 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:28:04 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Deleted volume successfully.
Sep 29 18:28:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4b6856f5-063f-4486-8fd4-b144dbe3be5d tempest-VolumeTypesAccessTest-347477707 None] Lock "cinder-3843d3ac-e07c-4702-a408-905a7e95bc9f-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:28:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=16,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:28:32 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Flow 'volume_create_manager' (9fb2eb9f-4c9f-4743-bce2-b90eff5fb3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb27c641-0526-4a11-b72a-924c61fdf7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb27c641-0526-4a11-b72a-924c61fdf7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-872331123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a203f88b-bd23-4db0-8e56-d1c5fd9d8674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a65052096204b06835cf7666d7a8d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:33Z,use_quota=True,user_id='87afdaa3b1784269ace8fe8dba2fbf20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c957da1b-a498-49c8-bca0-bad3d6d37625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c957da1b-a498-49c8-bca0-bad3d6d37625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b506850f-ff06-43d8-8d3b-2b17e3a6e78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b506850f-ff06-43d8-8d3b-2b17e3a6e78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a203f88b-bd23-4db0-8e56-d1c5fd9d8674', 'volume_name': 'volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401b5c0c-026d-43fb-b671-cefa52a1d753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401b5c0c-026d-43fb-b671-cefa52a1d753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c47fca-708d-476d-9b77-adecfe964cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:33 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Volume a203f88b-bd23-4db0-8e56-d1c5fd9d8674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674', 'volume_size': 1}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-872331123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a203f88b-bd23-4db0-8e56-d1c5fd9d8674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a65052096204b06835cf7666d7a8d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:33Z,use_quota=True,user_id='87afdaa3b1784269ace8fe8dba2fbf20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Creating volume a203f88b-bd23-4db0-8e56-d1c5fd9d8674 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:28:33 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:33 devstack sudo[101475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674 1073741824
Sep 29 18:28:33 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:33 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674 1073741824" returned: 0 in 0.594s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:33 devstack sudo[101481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674
Sep 29 18:28:33 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:34 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674" returned: 0 in 0.309s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:28:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c47fca-708d-476d-9b77-adecfe964cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e569f45-e463-48a1-a203-417f1f6fa920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:34 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Volume volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674 (a203f88b-bd23-4db0-8e56-d1c5fd9d8674): created successfully
Sep 29 18:28:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e569f45-e463-48a1-a203-417f1f6fa920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Flow 'volume_create_manager' (9fb2eb9f-4c9f-4743-bce2-b90eff5fb3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:34 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0b95ab9d-b419-43f3-9a1a-5e5393bd6843 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Created volume successfully.
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-2139c5ee-5c12-4146-af1d-6b70d6198535 req-2cb2c156-9c46-4b37-bec8-74b3483a3332 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-2139c5ee-5c12-4146-af1d-6b70d6198535 req-2cb2c156-9c46-4b37-bec8-74b3483a3332 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-2139c5ee-5c12-4146-af1d-6b70d6198535 req-2cb2c156-9c46-4b37-bec8-74b3483a3332 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-2139c5ee-5c12-4146-af1d-6b70d6198535 req-2cb2c156-9c46-4b37-bec8-74b3483a3332 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d42cc95-e34c-43d2-8190-b12257ffbd33', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Flow 'volume_create_manager' (b474fa26-190c-447b-8d51-a6d4739f5f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8975a4-f43a-4823-acdb-13dc9a422deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8975a4-f43a-4823-acdb-13dc9a422deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1769373492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=affc410c-f96f-4a3c-813b-676d07c882e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86fc0816fee4547ba5236cb74672439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:37Z,use_quota=True,user_id='d22921c1ec1b407497b801d9bf1cb7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac11a19a-c977-49aa-b39a-d132b4daa9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac11a19a-c977-49aa-b39a-d132b4daa9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25406367-352c-4aaa-9936-144ba50e31fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25406367-352c-4aaa-9936-144ba50e31fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'affc410c-f96f-4a3c-813b-676d07c882e4', 'volume_name': 'volume-affc410c-f96f-4a3c-813b-676d07c882e4', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e4f78c-4e2b-4463-a22c-919f3ae89fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e4f78c-4e2b-4463-a22c-919f3ae89fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6916922b-a8c4-4181-82a7-40ebbefba5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:36 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Volume affc410c-f96f-4a3c-813b-676d07c882e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-affc410c-f96f-4a3c-813b-676d07c882e4', 'volume_size': 1}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1769373492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=affc410c-f96f-4a3c-813b-676d07c882e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86fc0816fee4547ba5236cb74672439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:37Z,use_quota=True,user_id='d22921c1ec1b407497b801d9bf1cb7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Creating volume affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:28:36 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:28:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:36 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-2139c5ee-5c12-4146-af1d-6b70d6198535 req-2cb2c156-9c46-4b37-bec8-74b3483a3332 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] attachment_update completed successfully.
Sep 29 18:28:36 devstack sudo[101495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4 1073741824
Sep 29 18:28:36 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Flow 'volume_create_manager' (540ecec0-3471-442c-8b28-e8b269213d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d9cc5a-f26e-4c81-a5ee-ccf7dfff4f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d9cc5a-f26e-4c81-a5ee-ccf7dfff4f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1596455918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee22300e-96f5-4c0e-8828-cd25e60bfa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327c79aa520a4fa2bf60c3796f7c2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:37Z,use_quota=True,user_id='c248e4640973494b898f188e4eeb0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae515929-7faa-43ff-a477-3243f3782c40),volume_type_id=ae515929-7faa-43ff-a477-3243f3782c40)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611c37c0-94c9-4f7d-a4a9-6aaf6a2f0253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611c37c0-94c9-4f7d-a4a9-6aaf6a2f0253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a90bca-ec6c-46ac-9494-fe8d2b744fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a90bca-ec6c-46ac-9494-fe8d2b744fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee22300e-96f5-4c0e-8828-cd25e60bfa12', 'volume_name': 'volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703e1d2f-bf8b-4885-9cb5-2317f8d84593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703e1d2f-bf8b-4885-9cb5-2317f8d84593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3b3a13-e68c-4afc-94ea-5d8aa1537854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:37 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Volume ee22300e-96f5-4c0e-8828-cd25e60bfa12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12', 'volume_size': 1}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:28:37 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Flow 'volume_create_manager' (8744043f-be32-4d06-8f9d-a8c7692a7ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1813e90-9844-4e18-8e81-3409dc088186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4 1073741824" returned: 0 in 0.730s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1813e90-9844-4e18-8e81-3409dc088186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-881970887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46689075-99c9-494a-931e-077170ea1887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327c79aa520a4fa2bf60c3796f7c2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:38Z,use_quota=True,user_id='c248e4640973494b898f188e4eeb0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8c33e93-4696-48f3-aa84-8f1d0649dd96),volume_type_id=f8c33e93-4696-48f3-aa84-8f1d0649dd96)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f8b036-a545-46e6-acbc-c4c1ad6b66b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f8b036-a545-46e6-acbc-c4c1ad6b66b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed437dc4-ad00-47e1-a3a5-cdbb682d3a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed437dc4-ad00-47e1-a3a5-cdbb682d3a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46689075-99c9-494a-931e-077170ea1887', 'volume_name': 'volume-46689075-99c9-494a-931e-077170ea1887', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc9a1db-9da9-4790-bcef-565936fcde46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc9a1db-9da9-4790-bcef-565936fcde46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973a21a8-902a-438e-824d-e2efa7740c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:37 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Volume 46689075-99c9-494a-931e-077170ea1887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46689075-99c9-494a-931e-077170ea1887', 'volume_size': 1}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:37 devstack sudo[101919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4
Sep 29 18:28:37 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:38 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4" returned: 0 in 0.307s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1596455918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee22300e-96f5-4c0e-8828-cd25e60bfa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327c79aa520a4fa2bf60c3796f7c2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:37Z,use_quota=True,user_id='c248e4640973494b898f188e4eeb0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae515929-7faa-43ff-a477-3243f3782c40),volume_type_id=ae515929-7faa-43ff-a477-3243f3782c40)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Creating volume ee22300e-96f5-4c0e-8828-cd25e60bfa12 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:28:38 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6916922b-a8c4-4181-82a7-40ebbefba5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-affc410c-f96f-4a3c-813b-676d07c882e4', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:38 devstack sudo[101922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12 1073741824
Sep 29 18:28:38 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423ef328-0afa-4f3f-b00c-4b1471c7e378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:38 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Volume volume-affc410c-f96f-4a3c-813b-676d07c882e4 (affc410c-f96f-4a3c-813b-676d07c882e4): created successfully
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423ef328-0afa-4f3f-b00c-4b1471c7e378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Flow 'volume_create_manager' (b474fa26-190c-447b-8d51-a6d4739f5f59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:38 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0106f4e9-c1d0-45d3-ad94-69cbf07b96e8 tempest-VolumesDeleteCascade-540734389 None] Created volume successfully.
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:28:38 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Flow 'volume_create_manager' (fb61843f-a05b-45ca-9cf9-6603500c6168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65223b1a-4d29-4c35-a8da-adbc6283cdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12 1073741824" returned: 0 in 0.609s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65223b1a-4d29-4c35-a8da-adbc6283cdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-458230748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf1aebf-85b5-4951-9f2e-646591b83dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327c79aa520a4fa2bf60c3796f7c2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:39Z,use_quota=True,user_id='c248e4640973494b898f188e4eeb0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e921aae2-38c5-4b7e-ba67-c67ea5dd11f4),volume_type_id=e921aae2-38c5-4b7e-ba67-c67ea5dd11f4)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312440a4-160a-4f1f-ae28-831cabb112e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312440a4-160a-4f1f-ae28-831cabb112e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671f3710-cc1c-44c0-a984-25a5e5eec392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.image.glance [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Creating Keystone auth plugin from conf {{(pid=86821) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:38 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12
Sep 29 18:28:38 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671f3710-cc1c-44c0-a984-25a5e5eec392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4cf1aebf-85b5-4951-9f2e-646591b83dfb', 'volume_name': 'volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb', 'volume_size': 1, 'image_id': 'b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1893091872', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '327c79aa520a4fa2bf60c3796f7c2dc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'created_at': datetime.datetime(2026, 9, 29, 16, 28, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 28, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d645ef-4125-43ef-a7bd-b3bc79d046a1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b967cce90>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f55c077-2480-41a6-8c4b-bbae73e5810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f55c077-2480-41a6-8c4b-bbae73e5810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68fe974-6325-410e-9930-4af6fac25788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:38 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Volume 4cf1aebf-85b5-4951-9f2e-646591b83dfb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb', 'volume_size': 1, 'image_id': 'b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1893091872', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '327c79aa520a4fa2bf60c3796f7c2dc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'created_at': datetime.datetime(2026, 9, 29, 16, 28, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 28, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d645ef-4125-43ef-a7bd-b3bc79d046a1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b967cce90>}
Sep 29 18:28:38 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Trying to clone 4cf1aebf-85b5-4951-9f2e-646591b83dfb from image b7d645ef-4125-43ef-a7bd-b3bc79d046a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'metadata': {}}]). {{(pid=86821) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 18:28:39 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12" returned: 0 in 0.324s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-881970887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46689075-99c9-494a-931e-077170ea1887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327c79aa520a4fa2bf60c3796f7c2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:38Z,use_quota=True,user_id='c248e4640973494b898f188e4eeb0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8c33e93-4696-48f3-aa84-8f1d0649dd96),volume_type_id=f8c33e93-4696-48f3-aa84-8f1d0649dd96)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Creating volume 46689075-99c9-494a-931e-077170ea1887 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:28:39 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:39 devstack sudo[101931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887 1073741824
Sep 29 18:28:39 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3b3a13-e68c-4afc-94ea-5d8aa1537854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b01278-892c-440c-9d9e-3b6eadb551ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:39 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Volume volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12 (ee22300e-96f5-4c0e-8828-cd25e60bfa12): created successfully
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b01278-892c-440c-9d9e-3b6eadb551ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Flow 'volume_create_manager' (540ecec0-3471-442c-8b28-e8b269213d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:39 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3727340d-60ee-441d-947c-c22ec6f6012d tempest-TestInstancesWithCinderVolumes-543478195 None] Created volume successfully.
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:39 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887 1073741824" returned: 0 in 0.712s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:39 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887
Sep 29 18:28:39 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:40 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887" returned: 0 in 0.341s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.872s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] Creating offline snapshot 25fe3236-b102-4cf5-844c-4afbdd42d72e of volume affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973a21a8-902a-438e-824d-e2efa7740c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46689075-99c9-494a-931e-077170ea1887', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b386c5-1188-462f-aaf5-653fce6dd19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ddd8ed-a942-4ca5-bb9d-5501a6b9c14b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:40 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Volume volume-46689075-99c9-494a-931e-077170ea1887 (46689075-99c9-494a-931e-077170ea1887): created successfully
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b386c5-1188-462f-aaf5-653fce6dd19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Flow 'volume_create_manager' (8744043f-be32-4d06-8f9d-a8c7692a7ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-551e1017-82b3-4514-a30a-d1c84556ba93 tempest-TestInstancesWithCinderVolumes-543478195 None] Created volume successfully.
Sep 29 18:28:40 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4
Sep 29 18:28:40 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-9e4536a1-0e87-4624-b68d-6a095a0a3a3f req-eb208dea-126a-423d-abb0-7ee1e9b63524 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Terminate volume connection completed successfully.
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-9e4536a1-0e87-4624-b68d-6a095a0a3a3f req-eb208dea-126a-423d-abb0-7ee1e9b63524 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Deleting attachment 8d42cc95-e34c-43d2-8190-b12257ffbd33. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-30445492-4090-4b72-af1e-ff591d6c51ef req-88f18727-9914-46ff-9d14-c8d16c653e32 tempest-TestStampPattern-349576765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:40 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4" returned: 0 in 0.537s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:40 devstack sudo[101990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e 1G
Sep 29 18:28:40 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Acquiring lock "cinder-a203f88b-bd23-4db0-8e56-d1c5fd9d8674-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "cinder-a203f88b-bd23-4db0-8e56-d1c5fd9d8674-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Acquiring lock "cinder-quobyte-a203f88b-bd23-4db0-8e56-d1c5fd9d8674" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "cinder-quobyte-a203f88b-bd23-4db0-8e56-d1c5fd9d8674" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75df75d-1472-4b88-86f1-5e91d17d78b6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:41 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e 1G" returned: 0 in 0.476s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affc410c-f96f-4a3c-813b-676d07c882e4 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:41 devstack sudo[101997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affc410c-f96f-4a3c-813b-676d07c882e4 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e
Sep 29 18:28:41 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:41 devstack sudo[101996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674
Sep 29 18:28:41 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:41 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affc410c-f96f-4a3c-813b-676d07c882e4 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e" returned: 0 in 0.345s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:41 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e is being set with open permissions: ugo+rw
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:41 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674" returned: 0 in 0.421s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:41 devstack sudo[102008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e
Sep 29 18:28:41 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:41 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674
Sep 29 18:28:41 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:41 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e" returned: 0 in 0.296s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:41 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a203f88b-bd23-4db0-8e56-d1c5fd9d8674" returned: 0 in 0.299s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "cinder-quobyte-a203f88b-bd23-4db0-8e56-d1c5fd9d8674" released by "delete_volume" :: held 0.771s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:41 devstack sudo[102014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.info
Sep 29 18:28:41 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Created reservations ['9ebf22a9-daf3-4b4f-88d8-24ebcde904a8', '38393e15-6b30-4d69-9468-76a5e8f002a3', 'c90451a5-8135-4cbc-8927-2cc2fb3b6520', '936a0d54-b235-4268-8690-d93a7657d892'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:42 devstack sudo[102016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:28:42 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:42 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.info" returned: 0 in 0.311s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:42 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.info is being set with open permissions: ugo+rw
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:42 devstack sudo[102019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.info
Sep 29 18:28:42 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:42 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.327s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:28:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Deleted volume successfully.
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d354fc9c-6576-4eda-a0a4-3db531940649 tempest-TestServerVolumeAttachScenarioOldVersion-1262746817 None] Lock "cinder-a203f88b-bd23-4db0-8e56-d1c5fd9d8674-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:42 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.info" returned: 0 in 0.340s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-30445492-4090-4b72-af1e-ff591d6c51ef req-88f18727-9914-46ff-9d14-c8d16c653e32 tempest-TestStampPattern-349576765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.867s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-30445492-4090-4b72-af1e-ff591d6c51ef req-88f18727-9914-46ff-9d14-c8d16c653e32 tempest-TestStampPattern-349576765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-96f1c235-ed52-470c-9399-616a6dbfae92 tempest-VolumesDeleteCascade-540734389 None] Create snapshot completed successfully
Sep 29 18:28:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-30445492-4090-4b72-af1e-ff591d6c51ef req-88f18727-9914-46ff-9d14-c8d16c653e32 tempest-TestStampPattern-349576765 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-a4abda08-7642-43bd-8fcb-7e32d234924c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed487ac1-5eb2-4c4b-80e8-eefb12afabb0', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:28:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-30445492-4090-4b72-af1e-ff591d6c51ef req-88f18727-9914-46ff-9d14-c8d16c653e32 tempest-TestStampPattern-349576765 None] attachment_update completed successfully.
Sep 29 18:28:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] Creating offline snapshot c917daa0-5501-4fb8-a424-3f8f9a554739 of volume affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:28:44 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e61c0b-929e-483d-bf30-fd96b0349f49]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:44 devstack sudo[102464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e
Sep 29 18:28:44 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:44 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e" returned: 0 in 0.501s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-affc410c-f96f-4a3c-813b-676d07c882e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:28:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:44 devstack sudo[102471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 1G
Sep 29 18:28:44 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:44 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD, size 20.69 MB, duration 5.69 sec {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 18:28:44 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Image download 20.69 MB at 3.64 MB/s
Sep 29 18:28:44 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6d195c-467e-4566-8a50-7b7f008a442b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:44 devstack sudo[102474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD
Sep 29 18:28:44 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:45 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:45 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Temporary image b7d645ef-4125-43ef-a7bd-b3bc79d046a1 is fetched for user c248e4640973494b898f188e4eeb0fb6. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 18:28:45 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e50e33-79fa-49ea-83fa-96837179a3b7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:45 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 1G" returned: 0 in 0.712s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:45 devstack sudo[102493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739
Sep 29 18:28:45 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:45 devstack sudo[102492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD
Sep 29 18:28:45 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:45 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:45 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739" returned: 0 in 0.397s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:45 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 is being set with open permissions: ugo+rw
Sep 29 18:28:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:45 devstack sudo[102509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739
Sep 29 18:28:45 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:45 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739" returned: 0 in 0.280s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-458230748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf1aebf-85b5-4951-9f2e-646591b83dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327c79aa520a4fa2bf60c3796f7c2dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:39Z,use_quota=True,user_id='c248e4640973494b898f188e4eeb0fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e921aae2-38c5-4b7e-ba67-c67ea5dd11f4),volume_type_id=e921aae2-38c5-4b7e-ba67-c67ea5dd11f4)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Creating volume 4cf1aebf-85b5-4951-9f2e-646591b83dfb {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:28:46 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:46 devstack sudo[102514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb 1073741824
Sep 29 18:28:46 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8a423eea-3358-4c67-a46b-ae81bdc0caff tempest-VolumesDeleteCascade-540734389 None] Create snapshot completed successfully
Sep 29 18:28:46 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb 1073741824" returned: 0 in 0.478s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:46 devstack sudo[102523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb
Sep 29 18:28:46 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-6c02c88a-1114-4d8c-a89c-de187a7880b1 req-eeb1c37f-17b0-44ed-aab8-4f8078acb29d tempest-TestStampPattern-349576765 None] Terminate volume connection completed successfully.
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-6c02c88a-1114-4d8c-a89c-de187a7880b1 req-eeb1c37f-17b0-44ed-aab8-4f8078acb29d tempest-TestStampPattern-349576765 None] Deleting attachment ed487ac1-5eb2-4c4b-80e8-eefb12afabb0. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:28:46 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb" returned: 0 in 0.282s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Attempting download of b7d645ef-4125-43ef-a7bd-b3bc79d046a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'metadata': {}}])) to volume 4cf1aebf-85b5-4951-9f2e-646591b83dfb. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2909c6d0-1d1f-4c15-baea-deb0fd24aa64]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_0y7h53xe {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:47 devstack sudo[102553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_0y7h53xe
Sep 29 18:28:47 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-affc410c-f96f-4a3c-813b-676d07c882e4-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-affc410c-f96f-4a3c-813b-676d07c882e4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Performing cascade delete. {{(pid=86821) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-25fe3236-b102-4cf5-844c-4afbdd42d72e-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-25fe3236-b102-4cf5-844c-4afbdd42d72e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-quobyte-affc410c-f96f-4a3c-813b-676d07c882e4" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-affc410c-f96f-4a3c-813b-676d07c882e4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-quobyte-25fe3236-b102-4cf5-844c-4afbdd42d72e" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:47 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_0y7h53xe" returned: 0 in 0.409s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_0y7h53xe {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-25fe3236-b102-4cf5-844c-4afbdd42d72e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Deleting offline snapshot 25fe3236-b102-4cf5-844c-4afbdd42d72e of volume affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] snapshot_file for this snap is: volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f285651e-c7b2-4164-a214-eb0283605047]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:47 devstack sudo[102557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_0y7h53xe
Sep 29 18:28:47 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:47 devstack sudo[102558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e
Sep 29 18:28:47 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:47 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_0y7h53xe" returned: 1 in 0.427s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_0y7h53xe' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[07da09ab-355b-4d7f-b99a-fcd0cf5334a9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:47 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e" returned: 0 in 0.475s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-affc410c-f96f-4a3c-813b-676d07c882e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:28:47 devstack sudo[102563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD
Sep 29 18:28:47 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b04779-7dc4-4bb5-bad3-23844d4b3f29]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:48 devstack sudo[102568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4
Sep 29 18:28:48 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:48 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:48 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] b7d645ef-4125-43ef-a7bd-b3bc79d046a1 was qcow2, converting to qcow2 {{(pid=86821) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 18:28:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:48 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb
Sep 29 18:28:48 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:48 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4" returned: 0 in 0.616s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:48 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0751809-e149-4202-b1da-4d3047d1404a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:48 devstack sudo[102580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739
Sep 29 18:28:48 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:49 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739" returned: 0 in 0.657s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-affc410c-f96f-4a3c-813b-676d07c882e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:28:49 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e575e770-c99b-40ed-ae3b-30cd6ec68f84]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:49 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e
Sep 29 18:28:49 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:50 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e" returned: 0 in 0.688s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-affc410c-f96f-4a3c-813b-676d07c882e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:28:50 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e0dbdb-f717-4cd6-ac8f-56d618b76ffd]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:50 devstack sudo[102624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4
Sep 29 18:28:50 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:50 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4" returned: 0 in 0.548s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:50 devstack sudo[102629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e
Sep 29 18:28:50 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:51 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e" returned: 0 in 0.594s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:51 devstack sudo[102637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e
Sep 29 18:28:51 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:51 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb" returned: 0 in 3.189s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7d645ef-4125-43ef-a7bd-b3bc79d046a1_biffqsfkdevstack@QuobyteHD, size 112.00 MB, duration 3.19 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:28:51 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Converted 112.00 MB image at 35.10 MB/s
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:51 devstack sudo[102639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb 1G
Sep 29 18:28:51 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:51 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.25fe3236-b102-4cf5-844c-4afbdd42d72e" returned: 0 in 0.354s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affc410c-f96f-4a3c-813b-676d07c882e4 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 -F qcow2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:51 devstack sudo[102642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affc410c-f96f-4a3c-813b-676d07c882e4 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 -F qcow2
Sep 29 18:28:51 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:51 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb 1G" returned: 0 in 0.446s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Downloaded image b7d645ef-4125-43ef-a7bd-b3bc79d046a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'metadata': {}}])) to volume 4cf1aebf-85b5-4951-9f2e-646591b83dfb successfully. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Temporary image b7d645ef-4125-43ef-a7bd-b3bc79d046a1 for user c248e4640973494b898f188e4eeb0fb6 is deleted. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Marking volume 4cf1aebf-85b5-4951-9f2e-646591b83dfb as bootable. {{(pid=86821) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Copying metadata from image b7d645ef-4125-43ef-a7bd-b3bc79d046a1 to 4cf1aebf-85b5-4951-9f2e-646591b83dfb. {{(pid=86821) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 18:28:51 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Creating volume glance metadata for volume 4cf1aebf-85b5-4951-9f2e-646591b83dfb backed by image b7d645ef-4125-43ef-a7bd-b3bc79d046a1 with: {'image_id': 'b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'image_name': 'tempest-scenario-img--1893091872', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86821) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 18:28:51 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affc410c-f96f-4a3c-813b-676d07c882e4 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 -F qcow2" returned: 0 in 0.405s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Acquiring lock "cinder-a4abda08-7642-43bd-8fcb-7e32d234924c-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-25fe3236-b102-4cf5-844c-4afbdd42d72e" released by "_delete_snapshot" :: held 4.696s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Lock "cinder-a4abda08-7642-43bd-8fcb-7e32d234924c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-affc410c-f96f-4a3c-813b-676d07c882e4" released by "delete_snapshot" :: held 4.759s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Acquiring lock "cinder-quobyte-a4abda08-7642-43bd-8fcb-7e32d234924c" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68fe974-6325-410e-9930-4af6fac25788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb', 'volume_size': 1, 'image_id': 'b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1893091872', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '327c79aa520a4fa2bf60c3796f7c2dc6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b7d645ef-4125-43ef-a7bd-b3bc79d046a1', 'created_at': datetime.datetime(2026, 9, 29, 16, 28, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 28, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7d645ef-4125-43ef-a7bd-b3bc79d046a1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b967cce90>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a44a89-f769-453a-aa96-15184515c8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-a4abda08-7642-43bd-8fcb-7e32d234924c" acquired by "delete_volume" :: waited 0.041s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[945008dd-4d8c-447e-8bd1-cb300185e693]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:52 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Volume volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb (4cf1aebf-85b5-4951-9f2e-646591b83dfb): created successfully
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a44a89-f769-453a-aa96-15184515c8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Flow 'volume_create_manager' (fb61843f-a05b-45ca-9cf9-6603500c6168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:52 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-85a876eb-18ab-45bf-a083-b4f1ba65f835 tempest-TestInstancesWithCinderVolumes-543478195 None] Created volume successfully.
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Created reservations ['fa59e583-f953-44fc-90cd-0c60073a43b5', '7c98e501-d300-435a-adb5-9d88cbd242c7', '332c204f-5642-41ce-941e-80ef3472a24c', '3f65ceb0-75b6-4ecd-a561-166ad90a6a44'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:28:52 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Delete snapshot completed successfully.
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-25fe3236-b102-4cf5-844c-4afbdd42d72e-delete_snapshot" released by "delete_snapshot" :: held 5.102s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-c917daa0-5501-4fb8-a424-3f8f9a554739-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:52 devstack sudo[102652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c
Sep 29 18:28:52 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-c917daa0-5501-4fb8-a424-3f8f9a554739-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-quobyte-affc410c-f96f-4a3c-813b-676d07c882e4" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-affc410c-f96f-4a3c-813b-676d07c882e4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-quobyte-c917daa0-5501-4fb8-a424-3f8f9a554739" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-c917daa0-5501-4fb8-a424-3f8f9a554739" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Deleting offline snapshot c917daa0-5501-4fb8-a424-3f8f9a554739 of volume affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] snapshot_file for this snap is: volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[432e7e91-bcc8-4c6f-9cc8-efa6532a39ae]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:52 devstack sudo[102654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739
Sep 29 18:28:52 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:52 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c" returned: 0 in 0.442s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:52 devstack sudo[102659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c
Sep 29 18:28:52 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:52 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739" returned: 0 in 0.459s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-affc410c-f96f-4a3c-813b-676d07c882e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:28:53 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a4abda08-7642-43bd-8fcb-7e32d234924c" returned: 0 in 0.330s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[303a3b5d-a63d-4d20-81fd-cc593e3dd89b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-a4abda08-7642-43bd-8fcb-7e32d234924c" released by "delete_volume" :: held 0.870s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Created reservations ['75028621-7cef-4139-bdc8-7f16ec7f01a6', '02c36fc5-d424-4267-8ef5-208781d4bc5c', 'b564169a-4062-4e0f-a26a-7b242dea3fe9', '20f8087d-aaeb-48dd-9d87-5ab619a48121'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:28:53 devstack sudo[102667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4
Sep 29 18:28:53 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:53 devstack sudo[102669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:28:53 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:53 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4" returned: 0 in 0.520s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:53 devstack sudo[102674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739
Sep 29 18:28:53 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:53 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.330s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:28:53 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Deleted volume successfully.
Sep 29 18:28:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-eb52adb5-7345-4cc7-afa4-fa2c81b81a66 tempest-TestStampPattern-349576765 None] Lock "cinder-a4abda08-7642-43bd-8fcb-7e32d234924c-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:54 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739" returned: 0 in 0.507s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:54 devstack sudo[102681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739
Sep 29 18:28:54 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:54 devstack sudo[102688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:28:54 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:54 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4.c917daa0-5501-4fb8-a424-3f8f9a554739" returned: 0 in 0.433s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-c917daa0-5501-4fb8-a424-3f8f9a554739" released by "_delete_snapshot" :: held 2.150s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-affc410c-f96f-4a3c-813b-676d07c882e4" released by "delete_snapshot" :: held 2.179s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Created reservations ['129ca9cd-737e-44e7-87d2-324b70f23f73', '61d6b194-ae42-49b6-8858-c398303747b7', 'df547058-7ecc-48c4-880b-ede6a2cc9d5c', 'a1c0900b-2c59-4ff7-9a21-b00ec4bd2e0e'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:28:54 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Delete snapshot completed successfully.
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Acquiring lock "cinder-4a2ca47c-6fa2-459c-b928-6687d334eb3e-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.463s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-c917daa0-5501-4fb8-a424-3f8f9a554739-delete_snapshot" released by "delete_snapshot" :: held 2.477s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Snapshots deleted, issuing volume delete {{(pid=86821) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-quobyte-affc410c-f96f-4a3c-813b-676d07c882e4" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Lock "cinder-4a2ca47c-6fa2-459c-b928-6687d334eb3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Acquiring lock "cinder-quobyte-083611b1-abd3-4329-82b8-d4bc0c352b32" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-affc410c-f96f-4a3c-813b-676d07c882e4" acquired by "delete_volume" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-083611b1-abd3-4329-82b8-d4bc0c352b32" acquired by "delete_snapshot" :: waited 0.075s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Acquiring lock "cinder-quobyte-4a2ca47c-6fa2-459c-b928-6687d334eb3e" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[39334f34-5151-4ae7-8a0b-8960e4abef4c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-4a2ca47c-6fa2-459c-b928-6687d334eb3e" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Deleting offline snapshot 4a2ca47c-6fa2-459c-b928-6687d334eb3e of volume 083611b1-abd3-4329-82b8-d4bc0c352b32 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] snapshot_file for this snap is: volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[812ca808-2490-4ab8-8a70-a5f670484ea0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:55 devstack sudo[102691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4
Sep 29 18:28:55 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:55 devstack sudo[102692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e
Sep 29 18:28:55 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:55 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4" returned: 0 in 0.487s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:55 devstack sudo[102698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4
Sep 29 18:28:55 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:55 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e" returned: 0 in 0.537s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083611b1-abd3-4329-82b8-d4bc0c352b32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa6cee0-c231-4da4-9eab-b8a46aa5a383]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:55 devstack sudo[102703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32
Sep 29 18:28:55 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:55 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-affc410c-f96f-4a3c-813b-676d07c882e4" returned: 0 in 0.439s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-affc410c-f96f-4a3c-813b-676d07c882e4" released by "delete_volume" :: held 1.053s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Created reservations ['f2dc066c-bf44-41f3-aa2f-7d40c0589209', '64cc1141-a53e-44bd-aba8-2172226bcb6a', 'b10e4bd6-2572-4397-ac3a-183110af1edc', '604899b4-f11d-4151-beb7-1cbb3b46fbee'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:56 devstack sudo[102708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:28:56 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:56 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32" returned: 0 in 0.822s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:56 devstack sudo[102711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e
Sep 29 18:28:56 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:56 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.367s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:28:56 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Deleted volume successfully.
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-906489de-cf14-424a-8aa7-5f9824a738d0 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-affc410c-f96f-4a3c-813b-676d07c882e4-delete_volume" released by "delete_volume" :: held 9.535s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-bf7e6233-3977-4d6e-8113-79dbf21056f1 req-cd78abcb-1675-4d44-8f1b-e8f42a10b9fb tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-bf7e6233-3977-4d6e-8113-79dbf21056f1 req-cd78abcb-1675-4d44-8f1b-e8f42a10b9fb tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-bf7e6233-3977-4d6e-8113-79dbf21056f1 req-cd78abcb-1675-4d44-8f1b-e8f42a10b9fb tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-bf7e6233-3977-4d6e-8113-79dbf21056f1 req-cd78abcb-1675-4d44-8f1b-e8f42a10b9fb tempest-TestInstancesWithCinderVolumes-543478195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24413df6-49a3-490a-a5af-f08f424c4ccc', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:28:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-bf7e6233-3977-4d6e-8113-79dbf21056f1 req-cd78abcb-1675-4d44-8f1b-e8f42a10b9fb tempest-TestInstancesWithCinderVolumes-543478195 None] attachment_update completed successfully.
Sep 29 18:28:57 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e" returned: 0 in 0.543s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:57 devstack sudo[102726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e
Sep 29 18:28:57 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:57 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32.4a2ca47c-6fa2-459c-b928-6687d334eb3e" returned: 0 in 0.459s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-4a2ca47c-6fa2-459c-b928-6687d334eb3e" released by "_delete_snapshot" :: held 2.574s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-083611b1-abd3-4329-82b8-d4bc0c352b32" released by "delete_snapshot" :: held 2.628s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:57 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Created reservations ['ffd280eb-7a7d-4fbc-9524-bef25055e60e', 'c2ba920d-734d-4be0-8c56-846558b0b804', 'd9344162-f413-4904-a74a-06962d55b9f5', '8f8a83bd-c256-43de-b9fe-4a5d0fc32d99'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:28:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Delete snapshot completed successfully.
Sep 29 18:28:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a272831b-cc0c-4f39-b1c1-d184ce9ae5cf tempest-TestStampPattern-349576765 None] Lock "cinder-4a2ca47c-6fa2-459c-b928-6687d334eb3e-delete_snapshot" released by "delete_snapshot" :: held 2.901s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Flow 'volume_create_manager' (6654cdcc-98c9-4984-b371-e69d1f7aa810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772da5fd-2f4d-4cb3-9b28-2ea61fab4bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772da5fd-2f4d-4cb3-9b28-2ea61fab4bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-416211529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86fc0816fee4547ba5236cb74672439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:58Z,use_quota=True,user_id='d22921c1ec1b407497b801d9bf1cb7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f6fe5a-d6c3-4935-b5d9-cdcbb728f13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f6fe5a-d6c3-4935-b5d9-cdcbb728f13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebee4bc-dae2-4153-8758-6e6987911f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ebee4bc-dae2-4153-8758-6e6987911f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8', 'volume_name': 'volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db793c75-07bc-45d4-93b3-74f55d05966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db793c75-07bc-45d4-93b3-74f55d05966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac12d8dc-5840-4201-b621-1a4f1a9aeb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:58 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Volume 48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8', 'volume_size': 1}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-416211529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86fc0816fee4547ba5236cb74672439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:58Z,use_quota=True,user_id='d22921c1ec1b407497b801d9bf1cb7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Creating volume 48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:28:58 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:58 devstack sudo[102729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 1073741824
Sep 29 18:28:58 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:58 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 1073741824" returned: 0 in 0.485s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:28:59 devstack sudo[102735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8
Sep 29 18:28:59 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:28:59 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root
Sep 29 18:28:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" returned: 0 in 0.305s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:28:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:28:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:28:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac12d8dc-5840-4201-b621-1a4f1a9aeb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b7579-839a-423c-baef-fb75e46d44fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:28:59 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Volume volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 (48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8): created successfully
Sep 29 18:28:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b7579-839a-423c-baef-fb75e46d44fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:28:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Flow 'volume_create_manager' (6654cdcc-98c9-4984-b371-e69d1f7aa810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:28:59 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-60f8b4d2-afbc-43d8-a4d4-cae7cc695151 tempest-VolumesDeleteCascade-540734389 None] Created volume successfully.
Sep 29 18:29:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] Creating offline snapshot 74999eaf-5dbf-4dbe-be07-a98c1a360226 of volume 48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:29:01 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9463c00-bb7a-4ff8-9e6f-30c2d691d49c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:01 devstack sudo[102864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8
Sep 29 18:29:01 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:02 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" returned: 0 in 0.934s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:02 devstack sudo[103219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226 1G
Sep 29 18:29:02 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:02 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226 1G" returned: 0 in 0.734s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:02 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226
Sep 29 18:29:02 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:03 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226" returned: 0 in 0.568s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:03 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226 is being set with open permissions: ugo+rw
Sep 29 18:29:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:03 devstack sudo[103263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226
Sep 29 18:29:03 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:03 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226" returned: 0 in 0.597s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:04 devstack sudo[103279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.info
Sep 29 18:29:04 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Acquiring lock "cinder-083611b1-abd3-4329-82b8-d4bc0c352b32-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Lock "cinder-083611b1-abd3-4329-82b8-d4bc0c352b32-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Acquiring lock "cinder-quobyte-083611b1-abd3-4329-82b8-d4bc0c352b32" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-083611b1-abd3-4329-82b8-d4bc0c352b32" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:04 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4731e512-ac3a-4d2e-aab4-d75fd6344399]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:04 devstack sudo[103281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32
Sep 29 18:29:04 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:04 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.info" returned: 0 in 0.550s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:04 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.info is being set with open permissions: ugo+rw
Sep 29 18:29:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:04 devstack sudo[103284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.info
Sep 29 18:29:04 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:04 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.info" returned: 0 in 0.391s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.081s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:05 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32" returned: 0 in 0.673s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1c27f56f-9caa-4a94-887f-b56460790594 tempest-VolumesDeleteCascade-540734389 None] Create snapshot completed successfully
Sep 29 18:29:05 devstack sudo[103290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32
Sep 29 18:29:05 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:05 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-083611b1-abd3-4329-82b8-d4bc0c352b32" returned: 0 in 0.395s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Lock "cinder-quobyte-083611b1-abd3-4329-82b8-d4bc0c352b32" released by "delete_volume" :: held 1.155s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Created reservations ['ec66f22d-d04e-4b19-8170-1d7b3a0261f2', '0fb6b5ec-e405-46ff-a6f1-c572d5c1d940', '6902edf6-af02-4e12-b02d-23030eac7f30', '04e7b28d-d0f7-4a3e-b036-925d490a06c9'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:05 devstack sudo[103296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:29:05 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:06 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.353s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:06 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:29:06 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Deleted volume successfully.
Sep 29 18:29:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96b4e249-a936-420f-9d71-be2d222ea8e4 tempest-TestStampPattern-349576765 None] Lock "cinder-083611b1-abd3-4329-82b8-d4bc0c352b32-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Flow 'volume_create_manager' (da385a2b-29d7-48b3-aaa4-3897be2110ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c802ce-2ccf-44e6-8ea4-015d72f24bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c802ce-2ccf-44e6-8ea4-015d72f24bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1776415306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca934bb-f0fd-404f-abcc-90df11db80af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86fc0816fee4547ba5236cb74672439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=74999eaf-5dbf-4dbe-be07-a98c1a360226,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:07Z,use_quota=True,user_id='d22921c1ec1b407497b801d9bf1cb7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da9f98c-3660-41d5-ac43-6692c68951ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da9f98c-3660-41d5-ac43-6692c68951ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad44e2f-2abb-4cd7-9fa1-12a9fa0cf2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad44e2f-2abb-4cd7-9fa1-12a9fa0cf2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bca934bb-f0fd-404f-abcc-90df11db80af', 'volume_name': 'volume-bca934bb-f0fd-404f-abcc-90df11db80af', 'volume_size': 1, 'snapshot_id': '74999eaf-5dbf-4dbe-be07-a98c1a360226'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1958d8-0bc1-4c71-b047-03d2d2aa9cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1958d8-0bc1-4c71-b047-03d2d2aa9cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0953ca1f-0da0-4b83-a688-5005f1bbd7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:07 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Volume bca934bb-f0fd-404f-abcc-90df11db80af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bca934bb-f0fd-404f-abcc-90df11db80af', 'volume_size': 1, 'snapshot_id': '74999eaf-5dbf-4dbe-be07-a98c1a360226'}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-quobyte-74999eaf-5dbf-4dbe-be07-a98c1a360226-bca934bb-f0fd-404f-abcc-90df11db80af" by "_create_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-74999eaf-5dbf-4dbe-be07-a98c1a360226-bca934bb-f0fd-404f-abcc-90df11db80af" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Creating volume bca934bb-f0fd-404f-abcc-90df11db80af from snapshot 74999eaf-5dbf-4dbe-be07-a98c1a360226 {{(pid=86821) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-quobyte-bca934bb-f0fd-404f-abcc-90df11db80af" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-bca934bb-f0fd-404f-abcc-90df11db80af" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] snapshot: 74999eaf-5dbf-4dbe-be07-a98c1a360226, volume: bca934bb-f0fd-404f-abcc-90df11db80af,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25c663e-846d-4aaf-ab8e-2027c859e24f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:07 devstack sudo[103301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226
Sep 29 18:29:07 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:08 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226" returned: 0 in 0.753s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:29:08 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bfa793-b8d2-429a-acc6-536246948938]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:08 devstack sudo[103306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8
Sep 29 18:29:08 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:08 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" returned: 0 in 0.574s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:29:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:29:08 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:29:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:08 devstack sudo[103311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af
Sep 29 18:29:08 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:17 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=86,cinder:UPDATE=74,cinder:DELETE=11,cinder:INSERT=23 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:29:17 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=87,cinder:UPDATE=80,cinder:INSERT=22,cinder:DELETE=2 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:29:19 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af" returned: 0 in 10.425s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:19 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8, size 1024.00 MB, duration 10.43 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:29:19 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Converted 1024.00 MB image at 98.22 MB/s
Sep 29 18:29:19 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af is being set with open permissions: ugo+rw
Sep 29 18:29:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:19 devstack sudo[103329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af
Sep 29 18:29:19 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:19 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af" returned: 0 in 0.293s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-bca934bb-f0fd-404f-abcc-90df11db80af" released by "_copy_volume_from_snapshot" :: held 12.253s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-74999eaf-5dbf-4dbe-be07-a98c1a360226-bca934bb-f0fd-404f-abcc-90df11db80af" released by "_create_volume_from_snapshot" :: held 12.382s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.419s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0953ca1f-0da0-4b83-a688-5005f1bbd7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca934bb-f0fd-404f-abcc-90df11db80af', 'volume_size': 1, 'snapshot_id': '74999eaf-5dbf-4dbe-be07-a98c1a360226'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958d3237-3127-44ea-9c05-c7051b8b57af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:19 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Volume volume-bca934bb-f0fd-404f-abcc-90df11db80af (bca934bb-f0fd-404f-abcc-90df11db80af): created successfully
Sep 29 18:29:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958d3237-3127-44ea-9c05-c7051b8b57af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Flow 'volume_create_manager' (da385a2b-29d7-48b3-aaa4-3897be2110ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:19 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-b12f3974-ddc7-42dc-83ce-7e52c0510843 tempest-VolumesDeleteCascade-540734389 None] Created volume successfully.
Sep 29 18:29:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Performing cascade delete. {{(pid=86821) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-74999eaf-5dbf-4dbe-be07-a98c1a360226-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-74999eaf-5dbf-4dbe-be07-a98c1a360226-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-quobyte-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-quobyte-74999eaf-5dbf-4dbe-be07-a98c1a360226" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-74999eaf-5dbf-4dbe-be07-a98c1a360226" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Deleting offline snapshot 74999eaf-5dbf-4dbe-be07-a98c1a360226 of volume 48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] snapshot_file for this snap is: volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d0e3e8-45ec-4902-bc35-965841afd59b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:21 devstack sudo[103357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226
Sep 29 18:29:21 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:21 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226" returned: 0 in 0.507s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[11770aa3-82aa-461a-82e0-5d0fe26bb2cb]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:22 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8
Sep 29 18:29:22 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:22 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" returned: 0 in 0.820s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:22 devstack sudo[103370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226
Sep 29 18:29:22 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:23 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226" returned: 0 in 0.626s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:23 devstack sudo[103377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226
Sep 29 18:29:23 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:23 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8.74999eaf-5dbf-4dbe-be07-a98c1a360226" returned: 0 in 0.401s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-74999eaf-5dbf-4dbe-be07-a98c1a360226" released by "_delete_snapshot" :: held 2.547s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" released by "delete_snapshot" :: held 2.588s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:23 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Created reservations ['9bb0b2dd-bda4-4af0-86b3-0899cc22087c', 'e4dafcfa-82d1-4571-aa88-18e99302663b', '90a0ee13-f752-4ca3-a521-4750447a0822', '0ce8ad94-e6b4-40b7-b280-0a7fb5ae9abf'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:29:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Delete snapshot completed successfully.
Sep 29 18:29:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-74999eaf-5dbf-4dbe-be07-a98c1a360226-delete_snapshot" released by "delete_snapshot" :: held 2.898s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Snapshots deleted, issuing volume delete {{(pid=86821) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 29 18:29:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-quobyte-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:24 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3947857d-bad2-4052-a3ec-269c7887f5c7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:24 devstack sudo[103383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8
Sep 29 18:29:24 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:24 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" returned: 0 in 0.498s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:24 devstack sudo[103393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8
Sep 29 18:29:24 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:25 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" returned: 0 in 0.429s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8" released by "delete_volume" :: held 1.051s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Created reservations ['574d030b-6a10-4256-8dab-e365f081a985', '212627a2-c51b-4506-a815-91813d092d2a', '9c46c72d-0908-468b-a0df-88375cc33d97', 'ad02c25d-d1dc-4ba3-859e-4d0c95c77d8d'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:25 devstack sudo[103396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:29:25 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:25 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-bca934bb-f0fd-404f-abcc-90df11db80af-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.481s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-bca934bb-f0fd-404f-abcc-90df11db80af-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:25 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Deleted volume successfully.
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ffa3ecdb-d89d-4bb5-a859-71cf43bbf582 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-48c4ec0e-c9af-45df-8b5a-3a8c1a00dbf8-delete_volume" released by "delete_volume" :: held 4.897s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "cinder-quobyte-bca934bb-f0fd-404f-abcc-90df11db80af" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-bca934bb-f0fd-404f-abcc-90df11db80af" acquired by "delete_volume" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:26 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e69e8d3-2809-4979-b7b6-da3b9502de08]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:26 devstack sudo[103399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af
Sep 29 18:29:26 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:26 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af" returned: 0 in 0.679s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:26 devstack sudo[103416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af
Sep 29 18:29:26 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:27 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bca934bb-f0fd-404f-abcc-90df11db80af" returned: 0 in 0.450s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-quobyte-bca934bb-f0fd-404f-abcc-90df11db80af" released by "delete_volume" :: held 1.260s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Created reservations ['642f50c9-287b-4c98-83fe-e46d3c9f632e', 'a88bc4d3-a2d6-416c-8841-b4704c9f36fb', 'd9c0f63b-feac-4bf2-a88f-3b948ecc7de9', '6d967f8c-b57e-49c8-a73d-360a5052e0fa'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:27 devstack sudo[103456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:29:27 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:27 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:29:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Deleted volume successfully.
Sep 29 18:29:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34fdade6-2331-4a95-a5f4-82ef1b6eb920 tempest-VolumesDeleteCascade-540734389 None] Lock "cinder-bca934bb-f0fd-404f-abcc-90df11db80af-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Flow 'volume_create_manager' (62a871e6-8f27-4501-9c6a-bbb1fadf5cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469d4e54-7fb5-4c93-97f2-d4f02135ce7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (469d4e54-7fb5-4c93-97f2-d4f02135ce7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1511753514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11edfc2-c7ae-4bc8-b0f1-85e2f24df663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7c02abe6324ee2ae63ae9b8248a42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:37Z,use_quota=True,user_id='d3856798075f4a28bb87ddfd8127fdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2da4c9-a85f-4b7d-97eb-c436582f4bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2da4c9-a85f-4b7d-97eb-c436582f4bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2f4a4d-190c-4392-a3b7-45738d4822ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2f4a4d-190c-4392-a3b7-45738d4822ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd11edfc2-c7ae-4bc8-b0f1-85e2f24df663', 'volume_name': 'volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5692f7-b792-4e91-ac11-91b340e021a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5692f7-b792-4e91-ac11-91b340e021a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5f424f-205a-4125-a8ad-c6f597127133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:36 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Volume d11edfc2-c7ae-4bc8-b0f1-85e2f24df663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663', 'volume_size': 1}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1511753514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11edfc2-c7ae-4bc8-b0f1-85e2f24df663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7c02abe6324ee2ae63ae9b8248a42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:37Z,use_quota=True,user_id='d3856798075f4a28bb87ddfd8127fdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Creating volume d11edfc2-c7ae-4bc8-b0f1-85e2f24df663 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:29:36 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:29:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:36 devstack sudo[103469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663 1073741824
Sep 29 18:29:36 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:37 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663 1073741824" returned: 0 in 0.883s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:37 devstack sudo[103475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663
Sep 29 18:29:37 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:38 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663" returned: 0 in 0.367s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5f424f-205a-4125-a8ad-c6f597127133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b2f0e9-a755-4d06-8244-554d5cad8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:38 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Volume volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663 (d11edfc2-c7ae-4bc8-b0f1-85e2f24df663): created successfully
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b2f0e9-a755-4d06-8244-554d5cad8278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Flow 'volume_create_manager' (62a871e6-8f27-4501-9c6a-bbb1fadf5cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:38 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5b92dba1-cb5e-477b-9676-5b933f3d7ae4 tempest-VolumesTransfersV357Test-2051690448 None] Created volume successfully.
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (0cfd5e42-097d-485e-bdbd-cbc1121a54bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2efaae7-b5b7-4f5d-8a91-097666531710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2efaae7-b5b7-4f5d-8a91-097666531710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1714274570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d275d561-7262-451f-93f6-ba48393de074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:39Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a00d083-805e-4cac-b66d-6b3ce0c8320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a00d083-805e-4cac-b66d-6b3ce0c8320d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebac612a-4fd5-4b7e-9bdb-9b18bbe50e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebac612a-4fd5-4b7e-9bdb-9b18bbe50e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd275d561-7262-451f-93f6-ba48393de074', 'volume_name': 'volume-d275d561-7262-451f-93f6-ba48393de074', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94560108-2e41-4c29-8787-bbc294bf46bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94560108-2e41-4c29-8787-bbc294bf46bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869b329d-bd0d-4c7d-b156-e705d4376bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:38 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume d275d561-7262-451f-93f6-ba48393de074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d275d561-7262-451f-93f6-ba48393de074', 'volume_size': 1}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1714274570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d275d561-7262-451f-93f6-ba48393de074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:39Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Creating volume d275d561-7262-451f-93f6-ba48393de074 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:29:38 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:29:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:38 devstack sudo[103482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074 1073741824
Sep 29 18:29:38 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:39 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074 1073741824" returned: 0 in 0.855s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:39 devstack sudo[103491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074
Sep 29 18:29:39 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:40 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074" returned: 0 in 0.403s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:29:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869b329d-bd0d-4c7d-b156-e705d4376bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d275d561-7262-451f-93f6-ba48393de074', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6485839-eb2a-48ba-9d00-9d06835c1315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:40 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume volume-d275d561-7262-451f-93f6-ba48393de074 (d275d561-7262-451f-93f6-ba48393de074): created successfully
Sep 29 18:29:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6485839-eb2a-48ba-9d00-9d06835c1315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (0cfd5e42-097d-485e-bdbd-cbc1121a54bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-46650367-7bb6-44fd-b7cc-d2b4c85a63c0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created volume successfully.
Sep 29 18:29:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-749aa6c9-02db-4f1c-baea-1c27edfce1b5 tempest-VolumesTransfersV357Test-1960017600 None] Transfer volume completed successfully.
Sep 29 18:29:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-b796f287-1630-49f2-9be8-246f9186771b req-9589ba5e-a653-4d62-aec6-0110a2fca131 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-b796f287-1630-49f2-9be8-246f9186771b req-9589ba5e-a653-4d62-aec6-0110a2fca131 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-b796f287-1630-49f2-9be8-246f9186771b req-9589ba5e-a653-4d62-aec6-0110a2fca131 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-b796f287-1630-49f2-9be8-246f9186771b req-9589ba5e-a653-4d62-aec6-0110a2fca131 tempest-TestInstancesWithCinderVolumes-543478195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4335238e-921d-4789-baf4-c4e3e573bd2e', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:29:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-b796f287-1630-49f2-9be8-246f9186771b req-9589ba5e-a653-4d62-aec6-0110a2fca131 tempest-TestInstancesWithCinderVolumes-543478195 None] attachment_update completed successfully.
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] Creating offline snapshot a5e25a4f-877d-4281-96d5-cb5497f18337 of volume d275d561-7262-451f-93f6-ba48393de074 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce0b874-6e6a-4624-839f-612ca29fea9c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Acquiring lock "cinder-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:41 devstack sudo[103507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074
Sep 29 18:29:41 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Lock "cinder-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Acquiring lock "cinder-quobyte-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Lock "cinder-quobyte-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1d882d-83c9-4423-8638-9a967caeda67]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:41 devstack sudo[103509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663
Sep 29 18:29:41 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:41 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074" returned: 0 in 0.576s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:41 devstack sudo[103514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337 1G
Sep 29 18:29:41 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:42 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663" returned: 0 in 0.547s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:42 devstack sudo[103522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663
Sep 29 18:29:42 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:42 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337 1G" returned: 0 in 0.573s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d275d561-7262-451f-93f6-ba48393de074 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:42 devstack sudo[103528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d275d561-7262-451f-93f6-ba48393de074 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337
Sep 29 18:29:42 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:42 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663" returned: 0 in 0.316s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Lock "cinder-quobyte-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663" released by "delete_volume" :: held 0.951s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Created reservations ['9cb31315-dd54-49e4-ac3f-c5715a395be1', '6cb0fa95-4b66-4d63-acc7-da50c9a0a10d', '1f08fe43-800c-409e-a2b2-3d5e9164622c', '587a6cf5-722a-4214-ab9a-16b799422700'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:42 devstack sudo[103535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:29:42 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:42 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d275d561-7262-451f-93f6-ba48393de074 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337" returned: 0 in 0.433s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:42 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337 is being set with open permissions: ugo+rw
Sep 29 18:29:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:42 devstack sudo[103539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337
Sep 29 18:29:42 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:43 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.392s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:29:43 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Deleted volume successfully.
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3990196a-ae66-496e-830b-899c81b301b0 tempest-VolumesTransfersV357Test-1504943641 None] Lock "cinder-d11edfc2-c7ae-4bc8-b0f1-85e2f24df663-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:43 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Flow 'volume_create_manager' (98458a3e-19aa-48c3-be71-1ed85b928ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242cb6be-58bf-4869-afee-bd4c8317acf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337" returned: 0 in 0.395s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242cb6be-58bf-4869-afee-bd4c8317acf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-511578636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865d5a39-e724-408c-b49e-260e61ae16b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d1f8d3586a4324a13b388e6301e530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:43Z,use_quota=True,user_id='da3921ca8399409f8ef15f7d264253ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41021acd-c0a5-4f8a-b76e-ac68c546a2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41021acd-c0a5-4f8a-b76e-ac68c546a2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5f138f-b27a-49fd-9cfb-bcf4404d183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5f138f-b27a-49fd-9cfb-bcf4404d183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865d5a39-e724-408c-b49e-260e61ae16b9', 'volume_name': 'volume-865d5a39-e724-408c-b49e-260e61ae16b9', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536c4131-1ef4-4714-a72f-0a295ab3266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536c4131-1ef4-4714-a72f-0a295ab3266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccafb874-e1f3-41ab-81e8-2d71a0f3480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:43 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Volume 865d5a39-e724-408c-b49e-260e61ae16b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865d5a39-e724-408c-b49e-260e61ae16b9', 'volume_size': 1}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:43 devstack sudo[103547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.info
Sep 29 18:29:43 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Flow 'volume_create_manager' (7a300e71-957c-4891-bb8e-85770504ecf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7366fc6e-521a-4d4e-afa5-83d3d046bfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7366fc6e-521a-4d4e-afa5-83d3d046bfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2048656749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0733f047-c743-452d-8662-441d86c09396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d1f8d3586a4324a13b388e6301e530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:43Z,use_quota=True,user_id='da3921ca8399409f8ef15f7d264253ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4174306-a83a-4b38-a376-b9f09d3bd182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4174306-a83a-4b38-a376-b9f09d3bd182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd7dce4-c974-4739-b411-f02556938f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:43 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd7dce4-c974-4739-b411-f02556938f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0733f047-c743-452d-8662-441d86c09396', 'volume_name': 'volume-0733f047-c743-452d-8662-441d86c09396', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183ceb32-9aee-491a-9090-ed2614ea8c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183ceb32-9aee-491a-9090-ed2614ea8c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9749512b-dffc-4d2c-9cd0-5593272cad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:43 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Volume 0733f047-c743-452d-8662-441d86c09396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0733f047-c743-452d-8662-441d86c09396', 'volume_size': 1}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.info" returned: 0 in 0.401s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:43 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.info is being set with open permissions: ugo+rw
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:43 devstack sudo[103558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.info
Sep 29 18:29:43 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-8c68a819-4031-42ad-8f98-d0e8facd6375 req-fd2f1bcb-f19f-4a58-b740-08b2f124fff0 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:44 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.info" returned: 0 in 0.324s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.799s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-511578636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865d5a39-e724-408c-b49e-260e61ae16b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d1f8d3586a4324a13b388e6301e530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:43Z,use_quota=True,user_id='da3921ca8399409f8ef15f7d264253ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Creating volume 865d5a39-e724-408c-b49e-260e61ae16b9 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:29:44 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:44 devstack sudo[103561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9 1073741824
Sep 29 18:29:44 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:44 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-47229384-07dd-4add-a96d-17b6803d40ad tempest-CreateVolumesFromSnapshotTest-1347341364 None] Create snapshot completed successfully
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Flow 'volume_create_manager' (afe49b0d-168e-4fe8-ad99-03ba81ae8886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61320f1-725a-43c5-ab00-4d137d767e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61320f1-725a-43c5-ab00-4d137d767e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-832426353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be88569-9308-4232-a451-7f63eda04a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7c02abe6324ee2ae63ae9b8248a42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:44Z,use_quota=True,user_id='d3856798075f4a28bb87ddfd8127fdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfc5d5c-579f-4a91-98bd-facf31cac5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfc5d5c-579f-4a91-98bd-facf31cac5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8794323a-3a08-4c7d-a97a-b7f978341f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8794323a-3a08-4c7d-a97a-b7f978341f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2be88569-9308-4232-a451-7f63eda04a5c', 'volume_name': 'volume-2be88569-9308-4232-a451-7f63eda04a5c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b7585c-c060-4a60-bba4-54da9b27c5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b7585c-c060-4a60-bba4-54da9b27c5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e161a25-8686-4a55-8923-05addf7efce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:44 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Volume 2be88569-9308-4232-a451-7f63eda04a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2be88569-9308-4232-a451-7f63eda04a5c', 'volume_size': 1}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:44 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9 1073741824" returned: 0 in 0.621s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:44 devstack sudo[103568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9
Sep 29 18:29:44 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:45 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9" returned: 0 in 0.353s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2048656749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0733f047-c743-452d-8662-441d86c09396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d1f8d3586a4324a13b388e6301e530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:43Z,use_quota=True,user_id='da3921ca8399409f8ef15f7d264253ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Creating volume 0733f047-c743-452d-8662-441d86c09396 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:29:45 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:45 devstack sudo[103571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396 1073741824
Sep 29 18:29:45 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (049e969e-f816-4952-ae7b-9386fb74d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721885f5-2fe3-4794-ae61-8cd1aceede09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccafb874-e1f3-41ab-81e8-2d71a0f3480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865d5a39-e724-408c-b49e-260e61ae16b9', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3316d111-3550-4f57-af7b-31f60e435838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721885f5-2fe3-4794-ae61-8cd1aceede09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121544706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88866b1-c0c3-4ef3-9a91-018ad0af48ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:45Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d56f69-de9c-4499-abcd-c67ef1e00746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d56f69-de9c-4499-abcd-c67ef1e00746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ce7ae2-2b6e-4b68-86ec-284c7e817fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ce7ae2-2b6e-4b68-86ec-284c7e817fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88866b1-c0c3-4ef3-9a91-018ad0af48ef', 'volume_name': 'volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de96f73f-d23f-422b-8bd7-6b955062b9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de96f73f-d23f-422b-8bd7-6b955062b9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b0359b-45c2-48b8-be9e-f5440adc641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:45 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume c88866b1-c0c3-4ef3-9a91-018ad0af48ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef', 'volume_size': 1}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:45 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Volume volume-865d5a39-e724-408c-b49e-260e61ae16b9 (865d5a39-e724-408c-b49e-260e61ae16b9): created successfully
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3316d111-3550-4f57-af7b-31f60e435838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Flow 'volume_create_manager' (98458a3e-19aa-48c3-be71-1ed85b928ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-7a5e2468-f4c6-417b-9c97-a9817823b5fe tempest-TestServerVolumeAttachmentScenario-189532627 None] Created volume successfully.
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (c8ea29f8-3fea-4a3a-bdea-d23d8f0d062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a279fa-42b9-4efb-9def-52c3aebf8d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a279fa-42b9-4efb-9def-52c3aebf8d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1643902640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3430c6e0-07cc-41e1-9740-7707277f0a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:46Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba1850a-cd4c-44fc-b0b8-4e0769f623f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba1850a-cd4c-44fc-b0b8-4e0769f623f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49e845b-85b0-4e7d-babb-37f532ae6b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49e845b-85b0-4e7d-babb-37f532ae6b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3430c6e0-07cc-41e1-9740-7707277f0a1a', 'volume_name': 'volume-3430c6e0-07cc-41e1-9740-7707277f0a1a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:45 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b3036b-ae20-413a-b686-3c93056c30bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b3036b-ae20-413a-b686-3c93056c30bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41845543-78ca-4d98-9ca2-2622841c67e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:45 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume 3430c6e0-07cc-41e1-9740-7707277f0a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3430c6e0-07cc-41e1-9740-7707277f0a1a', 'volume_size': 1}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396 1073741824" returned: 0 in 0.664s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:45 devstack sudo[103576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396
Sep 29 18:29:45 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:29:46 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (138a2cf1-0978-4b72-9087-7abf5053869f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5205aea5-8d9e-46c1-960a-31bf91216976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396" returned: 0 in 0.369s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-8c68a819-4031-42ad-8f98-d0e8facd6375 req-fd2f1bcb-f19f-4a58-b740-08b2f124fff0 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.388s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5205aea5-8d9e-46c1-960a-31bf91216976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1875275546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3e999f-af85-46bc-bc23-690ca030cc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:46Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc82aa28-4023-44e2-b0e9-57f1bf638bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc82aa28-4023-44e2-b0e9-57f1bf638bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339dd29d-99b4-4986-accc-a9dcad0aa630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339dd29d-99b4-4986-accc-a9dcad0aa630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3e999f-af85-46bc-bc23-690ca030cc34', 'volume_name': 'volume-6e3e999f-af85-46bc-bc23-690ca030cc34', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18a1299-93eb-4614-8b45-a989edfbec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18a1299-93eb-4614-8b45-a989edfbec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a0aff9-ee3f-46fa-80ad-3ac9d86cdd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:46 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume 6e3e999f-af85-46bc-bc23-690ca030cc34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3e999f-af85-46bc-bc23-690ca030cc34', 'volume_size': 1}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9749512b-dffc-4d2c-9cd0-5593272cad0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0733f047-c743-452d-8662-441d86c09396', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860c46a1-8432-4566-87de-d4215e09e7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-8c68a819-4031-42ad-8f98-d0e8facd6375 req-fd2f1bcb-f19f-4a58-b740-08b2f124fff0 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.085s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.860s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-832426353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be88569-9308-4232-a451-7f63eda04a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7c02abe6324ee2ae63ae9b8248a42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:44Z,use_quota=True,user_id='d3856798075f4a28bb87ddfd8127fdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Creating volume 2be88569-9308-4232-a451-7f63eda04a5c {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:29:46 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:46 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Volume volume-0733f047-c743-452d-8662-441d86c09396 (0733f047-c743-452d-8662-441d86c09396): created successfully
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860c46a1-8432-4566-87de-d4215e09e7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Flow 'volume_create_manager' (7a300e71-957c-4891-bb8e-85770504ecf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:46 devstack sudo[103579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c 1073741824
Sep 29 18:29:46 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f8cdd729-7688-4333-a9f1-af59231ab793 tempest-TestServerVolumeAttachmentScenario-189532627 None] Created volume successfully.
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-8c68a819-4031-42ad-8f98-d0e8facd6375 req-fd2f1bcb-f19f-4a58-b740-08b2f124fff0 tempest-TestInstancesWithCinderVolumes-543478195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-46689075-99c9-494a-931e-077170ea1887', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '557cad62-0f37-4509-a07c-288821ac6eff', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:29:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-8c68a819-4031-42ad-8f98-d0e8facd6375 req-fd2f1bcb-f19f-4a58-b740-08b2f124fff0 tempest-TestInstancesWithCinderVolumes-543478195 None] attachment_update completed successfully.
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (1cc5f1b9-6da1-4653-8dd0-ad14ce6129ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4358940d-9573-4479-9686-85ddd1642dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4358940d-9573-4479-9686-85ddd1642dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2084758851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e223d6f-c48f-4647-a39f-b92024a53992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:47Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48928656-836b-4de8-b8ca-22365390af0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48928656-836b-4de8-b8ca-22365390af0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cde52ba-c35d-42db-ad2f-fde9751b9186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cde52ba-c35d-42db-ad2f-fde9751b9186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e223d6f-c48f-4647-a39f-b92024a53992', 'volume_name': 'volume-4e223d6f-c48f-4647-a39f-b92024a53992', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13c27f1-27ce-430d-a144-1697d4deba2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13c27f1-27ce-430d-a144-1697d4deba2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d621ecca-e4a1-4208-8a04-fbf94aa3bad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:46 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume 4e223d6f-c48f-4647-a39f-b92024a53992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e223d6f-c48f-4647-a39f-b92024a53992', 'volume_size': 1}
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:46 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c 1073741824" returned: 0 in 0.657s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:47 devstack sudo[103590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c
Sep 29 18:29:47 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (212d1988-61bd-4d10-b01d-011336cf696d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f305b65-69e5-4868-bfa4-28dd42935cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f305b65-69e5-4868-bfa4-28dd42935cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1018767499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af0d69a-e573-434a-ab05-cc59a49f6152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:47Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2352c6-25ec-4080-b737-930cb37793e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2352c6-25ec-4080-b737-930cb37793e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c8d4aa-6852-40b5-9967-683f07633e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c8d4aa-6852-40b5-9967-683f07633e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af0d69a-e573-434a-ab05-cc59a49f6152', 'volume_name': 'volume-7af0d69a-e573-434a-ab05-cc59a49f6152', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a688351a-de43-4824-9b0c-94b46c41cb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a688351a-de43-4824-9b0c-94b46c41cb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:47 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf53601-566c-4385-a1be-d767125112a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:47 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume 7af0d69a-e573-434a-ab05-cc59a49f6152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af0d69a-e573-434a-ab05-cc59a49f6152', 'volume_size': 1}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c" returned: 0 in 0.351s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121544706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88866b1-c0c3-4ef3-9a91-018ad0af48ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:45Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Creating volume c88866b1-c0c3-4ef3-9a91-018ad0af48ef {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:29:47 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:47 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef 1073741824
Sep 29 18:29:47 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e161a25-8686-4a55-8923-05addf7efce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be88569-9308-4232-a451-7f63eda04a5c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be9e0c9-754b-4c7a-a289-f827d3c83dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:47 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Volume volume-2be88569-9308-4232-a451-7f63eda04a5c (2be88569-9308-4232-a451-7f63eda04a5c): created successfully
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be9e0c9-754b-4c7a-a289-f827d3c83dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Flow 'volume_create_manager' (afe49b0d-168e-4fe8-ad99-03ba81ae8886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:47 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-96495413-9233-4bf4-9c98-847c08bf9809 tempest-VolumesTransfersV357Test-2051690448 None] Created volume successfully.
Sep 29 18:29:48 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef 1073741824" returned: 0 in 0.678s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:48 devstack sudo[103603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef
Sep 29 18:29:48 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Acquiring lock "cinder-2be88569-9308-4232-a451-7f63eda04a5c-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Lock "cinder-2be88569-9308-4232-a451-7f63eda04a5c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Acquiring lock "cinder-quobyte-2be88569-9308-4232-a451-7f63eda04a5c" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Lock "cinder-quobyte-2be88569-9308-4232-a451-7f63eda04a5c" acquired by "delete_volume" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[172d04e2-7c03-48c8-ae12-83a6923f4be3]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:48 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef" returned: 0 in 0.289s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.657s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1643902640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3430c6e0-07cc-41e1-9740-7707277f0a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:46Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Creating volume 3430c6e0-07cc-41e1-9740-7707277f0a1a {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:29:48 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b0359b-45c2-48b8-be9e-f5440adc641d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:48 devstack sudo[103605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c
Sep 29 18:29:48 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9807c4e-dbf8-4905-a4b3-897aef4ffa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:48 devstack sudo[103607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a 1073741824
Sep 29 18:29:48 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:48 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef (c88866b1-c0c3-4ef3-9a91-018ad0af48ef): created successfully
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9807c4e-dbf8-4905-a4b3-897aef4ffa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (049e969e-f816-4952-ae7b-9386fb74d39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:48 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-aac66a81-bc88-4689-af47-af7c9ab30c39 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created volume successfully.
Sep 29 18:29:48 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c" returned: 0 in 0.539s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:48 devstack sudo[103618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c
Sep 29 18:29:48 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:49 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a 1073741824" returned: 0 in 0.752s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:49 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a
Sep 29 18:29:49 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:49 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2be88569-9308-4232-a451-7f63eda04a5c" returned: 0 in 0.518s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Lock "cinder-quobyte-2be88569-9308-4232-a451-7f63eda04a5c" released by "delete_volume" :: held 1.131s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Created reservations ['802a9d67-e53f-4103-82b7-540a425877de', 'ad3633c5-aac8-4214-9491-5ee79c3a0d04', '0ec3779f-84bf-40a9-a6b4-01a7471d4623', '44462e04-ce43-4df1-a87e-ab7a98d8d42a'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:29:49 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a" returned: 0 in 0.348s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.375s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1875275546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3e999f-af85-46bc-bc23-690ca030cc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:46Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Creating volume 6e3e999f-af85-46bc-bc23-690ca030cc34 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:29:49 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:49 devstack sudo[103635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34 1073741824
Sep 29 18:29:49 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41845543-78ca-4d98-9ca2-2622841c67e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3430c6e0-07cc-41e1-9740-7707277f0a1a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:49 devstack sudo[103637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:29:49 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aabe477-9cbc-47a4-bd31-555b488df8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:49 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume volume-3430c6e0-07cc-41e1-9740-7707277f0a1a (3430c6e0-07cc-41e1-9740-7707277f0a1a): created successfully
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aabe477-9cbc-47a4-bd31-555b488df8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (c8ea29f8-3fea-4a3a-bdea-d23d8f0d062c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:49 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e300a35f-3637-42e1-bcef-8816381f4d3a tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created volume successfully.
Sep 29 18:29:50 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.428s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:50 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:29:50 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Deleted volume successfully.
Sep 29 18:29:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac223cda-ded1-4e1d-a6e7-e895799ec0a6 tempest-VolumesTransfersV357Test-1504943641 None] Lock "cinder-2be88569-9308-4232-a451-7f63eda04a5c-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:50 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34 1073741824" returned: 0 in 0.960s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:50 devstack sudo[103657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34
Sep 29 18:29:50 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:50 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34" returned: 0 in 0.322s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.197s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2084758851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e223d6f-c48f-4647-a39f-b92024a53992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:47Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Creating volume 4e223d6f-c48f-4647-a39f-b92024a53992 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:29:51 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a0aff9-ee3f-46fa-80ad-3ac9d86cdd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3e999f-af85-46bc-bc23-690ca030cc34', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:51 devstack sudo[103660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992 1073741824
Sep 29 18:29:51 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257595b6-924b-4563-a627-ea39d9d89f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:51 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume volume-6e3e999f-af85-46bc-bc23-690ca030cc34 (6e3e999f-af85-46bc-bc23-690ca030cc34): created successfully
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257595b6-924b-4563-a627-ea39d9d89f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (138a2cf1-0978-4b72-9087-7abf5053869f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:51 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0a75dbb0-2f62-4d2e-84a3-33c29dcdd82b tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created volume successfully.
Sep 29 18:29:51 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992 1073741824" returned: 0 in 0.659s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:51 devstack sudo[103665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992
Sep 29 18:29:51 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:52 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992" returned: 0 in 0.401s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.789s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1018767499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af0d69a-e573-434a-ab05-cc59a49f6152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6696424e19fa47e193ea14a2e4fb0124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:47Z,use_quota=True,user_id='b1130bc85486461b97c4032a7ab28374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Creating volume 7af0d69a-e573-434a-ab05-cc59a49f6152 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:29:52 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d621ecca-e4a1-4208-8a04-fbf94aa3bad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e223d6f-c48f-4647-a39f-b92024a53992', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6af0069-c94d-4908-8bc1-c077b00ad15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:52 devstack sudo[103673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152 1073741824
Sep 29 18:29:52 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:52 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume volume-4e223d6f-c48f-4647-a39f-b92024a53992 (4e223d6f-c48f-4647-a39f-b92024a53992): created successfully
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6af0069-c94d-4908-8bc1-c077b00ad15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (1cc5f1b9-6da1-4653-8dd0-ad14ce6129ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:52 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6742503c-be06-4fa9-badf-72dff88eedb2 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created volume successfully.
Sep 29 18:29:52 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152 1073741824" returned: 0 in 0.751s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:53 devstack sudo[103696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152
Sep 29 18:29:53 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152" returned: 0 in 0.379s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:29:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:53 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf53601-566c-4385-a1be-d767125112a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af0d69a-e573-434a-ab05-cc59a49f6152', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19da977e-8e6b-4f34-bdd7-ae52a69eb46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:29:53 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Volume volume-7af0d69a-e573-434a-ab05-cc59a49f6152 (7af0d69a-e573-434a-ab05-cc59a49f6152): created successfully
Sep 29 18:29:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19da977e-8e6b-4f34-bdd7-ae52a69eb46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:29:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Flow 'volume_create_manager' (212d1988-61bd-4d10-b01d-011336cf696d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:29:53 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-b1a9d597-e240-4ffc-9430-4a22c6bd5e13 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created volume successfully.
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:54 devstack sudo[103758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:29:54 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-7af0d69a-e573-434a-ab05-cc59a49f6152-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-7af0d69a-e573-434a-ab05-cc59a49f6152-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-quobyte-7af0d69a-e573-434a-ab05-cc59a49f6152" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-7af0d69a-e573-434a-ab05-cc59a49f6152" acquired by "delete_volume" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[111542fe-5041-418c-b533-b737d8a6e6b0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:54 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.486s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:29:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:29:54 devstack sudo[103766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152
Sep 29 18:29:54 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:55 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-ee0ef4ae-1a35-4559-bc8b-258314e799fc req-050bde6d-78b9-45e1-add0-0c1c9e3bba55 tempest-TestInstancesWithCinderVolumes-543478195 None] Terminate volume connection completed successfully.
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-ee0ef4ae-1a35-4559-bc8b-258314e799fc req-050bde6d-78b9-45e1-add0-0c1c9e3bba55 tempest-TestInstancesWithCinderVolumes-543478195 None] Deleting attachment 4335238e-921d-4789-baf4-c4e3e573bd2e. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:29:55 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152" returned: 0 in 0.737s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:55 devstack sudo[103799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152
Sep 29 18:29:55 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:55 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7af0d69a-e573-434a-ab05-cc59a49f6152" returned: 0 in 0.300s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-7af0d69a-e573-434a-ab05-cc59a49f6152" released by "delete_volume" :: held 1.125s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created reservations ['02a83a44-0836-482d-9df4-4c70d779fb52', '0e4696e9-2293-4096-a900-1e23342f06e8', '02cf0aba-0c06-44eb-a0c6-3b0bf83e232f', '4dc51da0-b3c4-428c-9a45-ae03d136d1fd'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:55 devstack sudo[103802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:29:55 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:56 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.360s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:56 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:29:56 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Deleted volume successfully.
Sep 29 18:29:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "cinder-ee22300e-96f5-4c0e-8828-cd25e60bfa12-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-69f5f08c-c47a-4683-a40f-b97556ccc0f0 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-7af0d69a-e573-434a-ab05-cc59a49f6152-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-ee22300e-96f5-4c0e-8828-cd25e60bfa12-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "cinder-quobyte-ee22300e-96f5-4c0e-8828-cd25e60bfa12" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-quobyte-ee22300e-96f5-4c0e-8828-cd25e60bfa12" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:56 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9631634-478a-45a7-aae4-e696e75e1204]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:56 devstack sudo[103811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12
Sep 29 18:29:56 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-4e223d6f-c48f-4647-a39f-b92024a53992-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-4e223d6f-c48f-4647-a39f-b92024a53992-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-quobyte-4e223d6f-c48f-4647-a39f-b92024a53992" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:57 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12" returned: 0 in 0.720s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-4e223d6f-c48f-4647-a39f-b92024a53992" acquired by "delete_volume" :: waited 0.063s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:57 devstack sudo[103816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12
Sep 29 18:29:57 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[92383027-cdc1-47f6-bc25-1327e0559d7c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:57 devstack sudo[103818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992
Sep 29 18:29:57 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:57 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ee22300e-96f5-4c0e-8828-cd25e60bfa12" returned: 0 in 0.372s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-quobyte-ee22300e-96f5-4c0e-8828-cd25e60bfa12" released by "delete_volume" :: held 1.227s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:57 devstack cinder-volume[86821]: WARNING cinder.quota [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-589658624-1431054738 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-589658624-1431054738, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:29:57 devstack cinder-volume[86821]: WARNING cinder.quota [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-589658624-1431054738 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-589658624-1431054738, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Created reservations ['39d5a689-c8d6-49c6-a843-1e0d11d70ee9', '34ea5b24-3f2e-4f6b-acdf-0d43745e6de4', '4ffbb1f4-8315-41b5-91d4-52a3cadad730', 'c2826765-831c-4079-a236-15c6fab24fc0'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:58 devstack sudo[103824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:29:58 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:58 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992" returned: 0 in 0.685s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:58 devstack sudo[103826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992
Sep 29 18:29:58 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:58 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4e223d6f-c48f-4647-a39f-b92024a53992" returned: 0 in 0.350s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-4e223d6f-c48f-4647-a39f-b92024a53992" released by "delete_volume" :: held 1.149s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created reservations ['9c514a74-b510-4a2e-9578-24c7ae5957bf', '82dd6c37-c12c-4747-bf3f-180e72b885b4', 'ed34d443-17b8-4c84-914a-3861de79d83a', '5b9f60ed-c58e-4e30-9b46-a08d862e3c87'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:29:58 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.743s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:29:58 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Deleted volume successfully.
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:29:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-57830ba1-4705-487e-bee2-b5d7f1d490d2 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-ee22300e-96f5-4c0e-8828-cd25e60bfa12-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:58 devstack sudo[103830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:29:58 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:29:59 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root
Sep 29 18:29:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.525s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:29:59 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:29:59 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Deleted volume successfully.
Sep 29 18:29:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ab700566-0f92-4d6f-a586-d6efef2edfc6 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-4e223d6f-c48f-4647-a39f-b92024a53992-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:29:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-6e3e999f-af85-46bc-bc23-690ca030cc34-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-6e3e999f-af85-46bc-bc23-690ca030cc34-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-quobyte-6e3e999f-af85-46bc-bc23-690ca030cc34" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:29:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-6e3e999f-af85-46bc-bc23-690ca030cc34" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:29:59 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7c2f44-3786-40ee-b891-7cd0ec26747f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:29:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:00 devstack sudo[103833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34
Sep 29 18:30:00 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:00 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34" returned: 0 in 0.783s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:00 devstack sudo[103844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34
Sep 29 18:30:00 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:00 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e3e999f-af85-46bc-bc23-690ca030cc34" returned: 0 in 0.369s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-6e3e999f-af85-46bc-bc23-690ca030cc34" released by "delete_volume" :: held 1.240s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:01 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created reservations ['00a1825a-6e73-4060-8af2-834a03f72a06', '9a5080f6-079a-4af7-bac6-399e693a31c4', '20e028ec-557e-4aa3-b92e-fc32c56b7115', '8eb6f099-79e9-426a-8a84-441d19a0b14a'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:01 devstack sudo[103855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:01 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:01 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.318s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:01 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:01 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Deleted volume successfully.
Sep 29 18:30:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-77b66ace-2063-4628-91ce-4c3b0c90a926 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-6e3e999f-af85-46bc-bc23-690ca030cc34-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-3430c6e0-07cc-41e1-9740-7707277f0a1a-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-3430c6e0-07cc-41e1-9740-7707277f0a1a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-quobyte-3430c6e0-07cc-41e1-9740-7707277f0a1a" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-3430c6e0-07cc-41e1-9740-7707277f0a1a" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ca520c-150a-47e0-bcaf-3d0c12e94083]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:02 devstack sudo[103866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a
Sep 29 18:30:02 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Flow 'volume_create_manager' (ae72ac58-f975-4a9e-8f40-903554b7e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2896cd2-39c6-4a67-8707-7bea02301c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2896cd2-39c6-4a67-8707-7bea02301c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-318957336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca703ca1-f755-4a5f-a29a-2bd343d01522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518ddbedc24640a1a457d7e9b68006d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:02Z,use_quota=True,user_id='969c21b786c446ff86aecc23f44d655e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f91ba91-d591-4231-8be7-2c8002f4a06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f91ba91-d591-4231-8be7-2c8002f4a06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07456988-2ebd-4dc1-b8d9-8dd94f306fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07456988-2ebd-4dc1-b8d9-8dd94f306fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca703ca1-f755-4a5f-a29a-2bd343d01522', 'volume_name': 'volume-ca703ca1-f755-4a5f-a29a-2bd343d01522', 'volume_size': 2}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634654d2-fb0f-4684-94e9-e1510d1317cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634654d2-fb0f-4684-94e9-e1510d1317cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a6a9e1-4202-4c90-840b-3cfb0aed908d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:02 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Volume ca703ca1-f755-4a5f-a29a-2bd343d01522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca703ca1-f755-4a5f-a29a-2bd343d01522', 'volume_size': 2}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-318957336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca703ca1-f755-4a5f-a29a-2bd343d01522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518ddbedc24640a1a457d7e9b68006d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:02Z,use_quota=True,user_id='969c21b786c446ff86aecc23f44d655e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Creating volume ca703ca1-f755-4a5f-a29a-2bd343d01522 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:02 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522 2147483648 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:02 devstack sudo[103871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522 2147483648
Sep 29 18:30:02 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:02 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a" returned: 0 in 0.481s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:02 devstack sudo[103877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a
Sep 29 18:30:02 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:02 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-de7213df-984c-4d62-9cfb-54fc32c164d5 req-d2c0440e-5829-437e-9ce8-4242b6a84ddf tempest-TestInstancesWithCinderVolumes-543478195 None] Terminate volume connection completed successfully.
Sep 29 18:30:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-de7213df-984c-4d62-9cfb-54fc32c164d5 req-d2c0440e-5829-437e-9ce8-4242b6a84ddf tempest-TestInstancesWithCinderVolumes-543478195 None] Deleting attachment 557cad62-0f37-4509-a07c-288821ac6eff. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:30:03 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3430c6e0-07cc-41e1-9740-7707277f0a1a" returned: 0 in 0.329s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-3430c6e0-07cc-41e1-9740-7707277f0a1a" released by "delete_volume" :: held 0.897s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created reservations ['f925527b-c0a3-425e-9bce-2a1f9f1533f1', '16444e45-c1eb-4e7f-89f9-ac00ffcaccbe', '276a6f0f-699c-41d6-8d99-fd94e51f32c1', '912035da-205d-4b0e-ad4e-88d7a4d81991'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:03 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522 2147483648" returned: 0 in 0.696s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:03 devstack sudo[103886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:03 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "cinder-46689075-99c9-494a-931e-077170ea1887-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-c88866b1-c0c3-4ef3-9a91-018ad0af48ef-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-46689075-99c9-494a-931e-077170ea1887-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-c88866b1-c0c3-4ef3-9a91-018ad0af48ef-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:03 devstack sudo[103888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522
Sep 29 18:30:03 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-quobyte-c88866b1-c0c3-4ef3-9a91-018ad0af48ef" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "cinder-quobyte-46689075-99c9-494a-931e-077170ea1887" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-c88866b1-c0c3-4ef3-9a91-018ad0af48ef" acquired by "delete_volume" :: waited 0.034s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-quobyte-46689075-99c9-494a-931e-077170ea1887" acquired by "delete_volume" :: waited 0.059s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f3f072-2147-4719-a107-76e9d96a0c75]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8c45a1-7c9e-44e2-be45-66094c70b792]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:03 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.532s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:03 devstack sudo[103891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef
Sep 29 18:30:03 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:03 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Deleted volume successfully.
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3fab8b2d-988e-4076-997b-190a3bcd9657 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-3430c6e0-07cc-41e1-9740-7707277f0a1a-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:03 devstack sudo[103892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887
Sep 29 18:30:03 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:03 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522" returned: 0 in 0.523s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a6a9e1-4202-4c90-840b-3cfb0aed908d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca703ca1-f755-4a5f-a29a-2bd343d01522', 'volume_size': 2}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d310bb1a-4017-4510-886a-62d6b84f5fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:03 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Volume volume-ca703ca1-f755-4a5f-a29a-2bd343d01522 (ca703ca1-f755-4a5f-a29a-2bd343d01522): created successfully
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d310bb1a-4017-4510-886a-62d6b84f5fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Flow 'volume_create_manager' (ae72ac58-f975-4a9e-8f40-903554b7e57f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:04 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-b5ad085c-920d-4366-8a80-b62267b45354 tempest-VolumesCloneNegativeTest-946118608 None] Created volume successfully.
Sep 29 18:30:04 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887" returned: 0 in 0.594s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:04 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:04 devstack sudo[103904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887
Sep 29 18:30:04 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef" returned: 0 in 0.660s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:04 devstack sudo[103906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef
Sep 29 18:30:04 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:04 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-46689075-99c9-494a-931e-077170ea1887" returned: 0 in 0.372s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-quobyte-46689075-99c9-494a-931e-077170ea1887" released by "delete_volume" :: held 1.053s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:04 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c88866b1-c0c3-4ef3-9a91-018ad0af48ef" returned: 0 in 0.393s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-c88866b1-c0c3-4ef3-9a91-018ad0af48ef" released by "delete_volume" :: held 1.164s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:04 devstack cinder-volume[86821]: WARNING cinder.quota [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1506584645-1079194268 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1506584645-1079194268, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:30:04 devstack cinder-volume[86821]: WARNING cinder.quota [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1506584645-1079194268 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1506584645-1079194268, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Created reservations ['9b2c85e4-9550-46de-8be6-ce6f07e24b63', '9b6bd32c-d018-4938-a359-16079bba539e', 'ac21974b-f501-4b27-877a-c3bb270d216b', '1f2e0a4a-1df5-4622-94fd-7fb5ba21e0b2'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created reservations ['74d8bd79-f783-49ca-af51-805b1fa64ab3', '05d48dd7-e2c4-4e17-a86a-7a778e6d5f3e', '36d16432-dda4-49ed-b580-637057db36f0', '72eb3ef6-618f-45f9-9341-ac91247fc59a'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Acquiring lock "cinder-ca703ca1-f755-4a5f-a29a-2bd343d01522-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:05 devstack sudo[103910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:05 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Lock "cinder-ca703ca1-f755-4a5f-a29a-2bd343d01522-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:05 devstack sudo[103913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:05 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Acquiring lock "cinder-quobyte-ca703ca1-f755-4a5f-a29a-2bd343d01522" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Lock "cinder-quobyte-ca703ca1-f755-4a5f-a29a-2bd343d01522" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c72401-713f-40b0-93b6-7b3712b0278a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:05 devstack sudo[103915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522
Sep 29 18:30:05 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:05 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.568s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Deleted volume successfully.
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-830370ed-c788-4b9c-af4a-f3ae50005ff9 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-46689075-99c9-494a-931e-077170ea1887-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:05 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.591s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Deleted volume successfully.
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-17803e50-a472-4b6e-bbd2-3d4a23c01563 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-c88866b1-c0c3-4ef3-9a91-018ad0af48ef-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-a5e25a4f-877d-4281-96d5-cb5497f18337-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-a5e25a4f-877d-4281-96d5-cb5497f18337-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-quobyte-d275d561-7262-451f-93f6-ba48393de074" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-d275d561-7262-451f-93f6-ba48393de074" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-quobyte-a5e25a4f-877d-4281-96d5-cb5497f18337" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-a5e25a4f-877d-4281-96d5-cb5497f18337" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Deleting offline snapshot a5e25a4f-877d-4281-96d5-cb5497f18337 of volume d275d561-7262-451f-93f6-ba48393de074 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] snapshot_file for this snap is: volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc76acce-c4f7-4e24-affe-82289fdfd139]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:06 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522" returned: 0 in 0.777s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:06 devstack sudo[103923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522
Sep 29 18:30:06 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:06 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337
Sep 29 18:30:06 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:06 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ca703ca1-f755-4a5f-a29a-2bd343d01522" returned: 0 in 0.526s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Lock "cinder-quobyte-ca703ca1-f755-4a5f-a29a-2bd343d01522" released by "delete_volume" :: held 1.388s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:06 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337" returned: 0 in 0.623s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d275d561-7262-451f-93f6-ba48393de074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a44c11-fcac-49ea-968d-a50e774b77bf]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Created reservations ['fec60963-885c-4cf3-a9db-c3f4862559d7', '9077000b-8289-44cd-a9b9-957f908537f4', '5ccfd50f-029e-4e9c-bab1-c3e15f46212b', 'ec54230b-cf97-429c-98e6-3bf4a12653e0'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:06 devstack sudo[103932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074
Sep 29 18:30:06 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:06 devstack sudo[103934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:06 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:07 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.439s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:07 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:07 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Deleted volume successfully.
Sep 29 18:30:07 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074" returned: 0 in 0.618s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-201dccd1-7f4b-4759-be74-b7ac622f2e8e tempest-VolumesCloneNegativeTest-946118608 None] Lock "cinder-ca703ca1-f755-4a5f-a29a-2bd343d01522-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:07 devstack sudo[103943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337
Sep 29 18:30:07 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:07 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337" returned: 0 in 0.600s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:07 devstack sudo[103952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337
Sep 29 18:30:07 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:08 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074.a5e25a4f-877d-4281-96d5-cb5497f18337" returned: 0 in 0.474s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:08 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-a5e25a4f-877d-4281-96d5-cb5497f18337" released by "_delete_snapshot" :: held 2.606s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:08 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-d275d561-7262-451f-93f6-ba48393de074" released by "delete_snapshot" :: held 2.651s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:08 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created reservations ['b358cdc2-d323-4fb5-9450-857f5916efd7', 'ffb1abd1-ef95-45e9-a502-921dc67151ee', 'fb2a91ab-de4d-4d16-be9e-2b38ea0a4d94', '29016c33-1548-4dc5-ab6f-2f299aaedd24'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:08 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Delete snapshot completed successfully.
Sep 29 18:30:08 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e5b469d-7da8-4248-8323-c84c0eda5bae tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-a5e25a4f-877d-4281-96d5-cb5497f18337-delete_snapshot" released by "delete_snapshot" :: held 3.063s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-d275d561-7262-451f-93f6-ba48393de074-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-d275d561-7262-451f-93f6-ba48393de074-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "cinder-quobyte-d275d561-7262-451f-93f6-ba48393de074" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-d275d561-7262-451f-93f6-ba48393de074" acquired by "delete_volume" :: waited 0.042s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:09 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc507f8c-64d9-4fde-9681-10f5692aaac0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:09 devstack sudo[103977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074
Sep 29 18:30:09 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:10 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074" returned: 0 in 0.588s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:10 devstack sudo[104001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074
Sep 29 18:30:10 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:10 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-f5bee3fc-4206-4b9c-9382-01519a8b7fcd req-26949c99-e2d9-49bb-b798-6dbe8430c125 tempest-TestInstancesWithCinderVolumes-543478195 None] Terminate volume connection completed successfully.
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-f5bee3fc-4206-4b9c-9382-01519a8b7fcd req-26949c99-e2d9-49bb-b798-6dbe8430c125 tempest-TestInstancesWithCinderVolumes-543478195 None] Deleting attachment 24413df6-49a3-490a-a5af-f08f424c4ccc. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:30:10 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d275d561-7262-451f-93f6-ba48393de074" returned: 0 in 0.466s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-quobyte-d275d561-7262-451f-93f6-ba48393de074" released by "delete_volume" :: held 1.201s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Created reservations ['b41fa30b-1fba-4fde-8237-ad52f15da6b1', '26c65495-c069-493f-ac3b-c192acb379d4', '91dc6ad4-29ea-4cc0-991d-16e9d8e1296b', 'ee03aab8-5139-469f-8ace-67ad6a954d80'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:10 devstack sudo[104005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:10 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:11 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.309s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:11 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:11 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Deleted volume successfully.
Sep 29 18:30:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c82028c1-1cde-4ce0-a1f3-0123826bf3c7 tempest-CreateVolumesFromSnapshotTest-1347341364 None] Lock "cinder-d275d561-7262-451f-93f6-ba48393de074-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "cinder-4cf1aebf-85b5-4951-9f2e-646591b83dfb-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-4cf1aebf-85b5-4951-9f2e-646591b83dfb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "cinder-quobyte-4cf1aebf-85b5-4951-9f2e-646591b83dfb" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-quobyte-4cf1aebf-85b5-4951-9f2e-646591b83dfb" acquired by "delete_volume" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:11 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[460c5f61-f831-4931-8b89-3548104fa15a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:11 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb
Sep 29 18:30:11 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:11 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb" returned: 0 in 0.388s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:11 devstack sudo[104014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb
Sep 29 18:30:11 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:12 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4cf1aebf-85b5-4951-9f2e-646591b83dfb" returned: 0 in 0.275s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-quobyte-4cf1aebf-85b5-4951-9f2e-646591b83dfb" released by "delete_volume" :: held 0.723s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:12 devstack cinder-volume[86821]: WARNING cinder.quota [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1121881640-2122860501 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1121881640-2122860501, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:30:12 devstack cinder-volume[86821]: WARNING cinder.quota [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1121881640-2122860501 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1121881640-2122860501, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Created reservations ['75f68cf4-aa54-477f-a799-4c723c6934ed', 'f8973d66-2b96-48f6-9e64-8997b745417b', 'c70a90de-39fc-4ca3-8c85-b9c07a873231', 'debb9861-2904-42be-b549-e16b0f8aa1e7'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:12 devstack sudo[104017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:12 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:12 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.353s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:12 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Deleted volume successfully.
Sep 29 18:30:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a2fb822b-b953-4474-b198-5fbdb4ebab56 tempest-TestInstancesWithCinderVolumes-543478195 None] Lock "cinder-4cf1aebf-85b5-4951-9f2e-646591b83dfb-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Flow 'volume_create_manager' (4bf9d78b-eaea-456e-bc77-3176eda4620c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef4b6d2-c936-4108-816b-5913efaf783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef4b6d2-c936-4108-816b-5913efaf783b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a8493a-ef6f-4bc4-88f4-bf0afd5c474e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7a248a676d4cb2be874a9810dd56b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:15Z,use_quota=True,user_id='0448fb1261be4aa2b673fa78b4cf1982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e50db9c-11a7-40c5-a5c4-925f490fee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e50db9c-11a7-40c5-a5c4-925f490fee82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da973671-115a-48a1-bdcc-b86fc1f4518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da973671-115a-48a1-bdcc-b86fc1f4518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a8493a-ef6f-4bc4-88f4-bf0afd5c474e', 'volume_name': 'volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d235dd4-3339-4d9d-a37f-6eb2a1c56fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d235dd4-3339-4d9d-a37f-6eb2a1c56fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b0da38-0e8a-4b58-b732-f1d2267093e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:15 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Volume 27a8493a-ef6f-4bc4-88f4-bf0afd5c474e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e', 'volume_size': 1}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a8493a-ef6f-4bc4-88f4-bf0afd5c474e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7a248a676d4cb2be874a9810dd56b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:15Z,use_quota=True,user_id='0448fb1261be4aa2b673fa78b4cf1982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Creating volume 27a8493a-ef6f-4bc4-88f4-bf0afd5c474e {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:15 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:15 devstack sudo[104031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e 1073741824
Sep 29 18:30:15 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:16 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e 1073741824" returned: 0 in 0.582s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:16 devstack sudo[104039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e
Sep 29 18:30:16 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:16 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e" returned: 0 in 0.290s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b0da38-0e8a-4b58-b732-f1d2267093e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992b4564-2126-448a-95d8-8c9bef807999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:16 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Volume volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e (27a8493a-ef6f-4bc4-88f4-bf0afd5c474e): created successfully
Sep 29 18:30:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992b4564-2126-448a-95d8-8c9bef807999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Flow 'volume_create_manager' (4bf9d78b-eaea-456e-bc77-3176eda4620c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:16 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a818c3f9-4f07-4167-80a4-65735237cdb1 tempest-CinderUnicodeTest-1383702246 None] Created volume successfully.
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=176,cinder:DELETE=13,cinder:SELECT=129,cinder:INSERT=35 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=126,cinder:INSERT=43,cinder:UPDATE=158,cinder:DELETE=15 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Flow 'volume_create_manager' (733d58a1-21a7-4579-8496-06d9a9c61315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2021f60c-669f-49c6-90d7-13688ffd68a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2021f60c-669f-49c6-90d7-13688ffd68a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1397057626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97767f5-50cf-4abf-8180-9cce61de7702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7112faaed5ee4a4c8babefb5dc2b369e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:17Z,use_quota=True,user_id='c4f8771c65874f17bc882f699f2c770a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1ee053-af2b-4027-b170-c5465272d7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1ee053-af2b-4027-b170-c5465272d7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819f22eb-3a58-4c99-8638-9ef2f3d39829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819f22eb-3a58-4c99-8638-9ef2f3d39829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97767f5-50cf-4abf-8180-9cce61de7702', 'volume_name': 'volume-b97767f5-50cf-4abf-8180-9cce61de7702', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637ff657-1bf6-4168-8115-f48328fdedc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637ff657-1bf6-4168-8115-f48328fdedc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03d3273-2f20-4f75-bbc1-f355cc251829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:17 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Volume b97767f5-50cf-4abf-8180-9cce61de7702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97767f5-50cf-4abf-8180-9cce61de7702', 'volume_size': 1}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1397057626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97767f5-50cf-4abf-8180-9cce61de7702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7112faaed5ee4a4c8babefb5dc2b369e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:17Z,use_quota=True,user_id='c4f8771c65874f17bc882f699f2c770a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Creating volume b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:17 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:17 devstack sudo[104042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702 1073741824
Sep 29 18:30:17 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:18 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Flow 'volume_create_manager' (24509435-cd4d-4a50-895d-c2b76f41a1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95786987-a041-4a13-b6e3-e7a10ce6fd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702 1073741824" returned: 0 in 0.774s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95786987-a041-4a13-b6e3-e7a10ce6fd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-350561448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7c975e-c189-495e-993d-d39d96832ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7a248a676d4cb2be874a9810dd56b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:18Z,use_quota=True,user_id='0448fb1261be4aa2b673fa78b4cf1982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695a7443-7060-40ac-816b-fa75c5cff284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695a7443-7060-40ac-816b-fa75c5cff284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c9bcfa-f7f5-49b7-a212-ae1f37130985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c9bcfa-f7f5-49b7-a212-ae1f37130985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7c975e-c189-495e-993d-d39d96832ae6', 'volume_name': 'volume-3f7c975e-c189-495e-993d-d39d96832ae6', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77bbeaf-1087-4b1c-a581-3b65d0381068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77bbeaf-1087-4b1c-a581-3b65d0381068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51424b0d-5987-4f85-83b4-c751296bab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:18 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Volume 3f7c975e-c189-495e-993d-d39d96832ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7c975e-c189-495e-993d-d39d96832ae6', 'volume_size': 1}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:18 devstack sudo[104048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702
Sep 29 18:30:18 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:18 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702" returned: 0 in 0.290s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-350561448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7c975e-c189-495e-993d-d39d96832ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7a248a676d4cb2be874a9810dd56b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:18Z,use_quota=True,user_id='0448fb1261be4aa2b673fa78b4cf1982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Creating volume 3f7c975e-c189-495e-993d-d39d96832ae6 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:18 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03d3273-2f20-4f75-bbc1-f355cc251829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97767f5-50cf-4abf-8180-9cce61de7702', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:18 devstack sudo[104051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6 1073741824
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e3a5bc-8977-412e-8a92-0d6076ab472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:18 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:18 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Volume volume-b97767f5-50cf-4abf-8180-9cce61de7702 (b97767f5-50cf-4abf-8180-9cce61de7702): created successfully
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e3a5bc-8977-412e-8a92-0d6076ab472a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Flow 'volume_create_manager' (733d58a1-21a7-4579-8496-06d9a9c61315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:18 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-7bb8b021-c286-4013-aca8-777804ec2cdd tempest-VolumesSnapshotListTestJSON-1307372882 None] Created volume successfully.
Sep 29 18:30:19 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6 1073741824" returned: 0 in 0.679s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:19 devstack sudo[104058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6
Sep 29 18:30:19 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:19 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6" returned: 0 in 0.382s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] Creating offline snapshot f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 of volume b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:30:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51424b0d-5987-4f85-83b4-c751296bab48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7c975e-c189-495e-993d-d39d96832ae6', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314991d8-c65a-459b-a6fc-5e5897f1088b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:20 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[580c4273-4d7e-40a8-8cb4-c0d540bde4a2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:20 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Volume volume-3f7c975e-c189-495e-993d-d39d96832ae6 (3f7c975e-c189-495e-993d-d39d96832ae6): created successfully
Sep 29 18:30:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314991d8-c65a-459b-a6fc-5e5897f1088b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Flow 'volume_create_manager' (24509435-cd4d-4a50-895d-c2b76f41a1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:20 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c3506566-a81a-4e68-9e07-0722aba09a80 tempest-CinderUnicodeTest-1383702246 None] Created volume successfully.
Sep 29 18:30:20 devstack sudo[104061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702
Sep 29 18:30:20 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:20 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702" returned: 0 in 0.537s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:20 devstack sudo[104068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 1G
Sep 29 18:30:20 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:21 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 1G" returned: 0 in 0.636s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97767f5-50cf-4abf-8180-9cce61de7702 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:21 devstack sudo[104074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97767f5-50cf-4abf-8180-9cce61de7702 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0
Sep 29 18:30:21 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:21 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97767f5-50cf-4abf-8180-9cce61de7702 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0" returned: 0 in 0.407s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:21 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 is being set with open permissions: ugo+rw
Sep 29 18:30:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:21 devstack sudo[104084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0
Sep 29 18:30:21 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:21 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0" returned: 0 in 0.339s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-a7437209-a33f-4d44-ae78-18d08e9d2961 req-b4f48293-42aa-4d7a-a318-3c91063d35db tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:22 devstack sudo[104095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.info
Sep 29 18:30:22 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:22 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.info" returned: 0 in 0.273s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:22 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.info is being set with open permissions: ugo+rw
Sep 29 18:30:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:22 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.info
Sep 29 18:30:22 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:22 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.info" returned: 0 in 0.269s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.622s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.740s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] Creating offline snapshot 0494dcb2-6e08-419a-82a2-ba0acbe4802a of volume 3f7c975e-c189-495e-993d-d39d96832ae6 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:30:22 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-128383bf-3b40-427b-8b4b-c77769361ccb tempest-VolumesSnapshotListTestJSON-1307372882 None] Create snapshot completed successfully
Sep 29 18:30:22 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ec0cba-6379-4ca6-85cd-f61432e741bc]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:22 devstack sudo[104101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6
Sep 29 18:30:22 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:23 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6" returned: 0 in 0.384s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:23 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a 1G
Sep 29 18:30:23 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:23 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a 1G" returned: 0 in 0.551s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f7c975e-c189-495e-993d-d39d96832ae6 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:23 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f7c975e-c189-495e-993d-d39d96832ae6 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a
Sep 29 18:30:23 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:23 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f7c975e-c189-495e-993d-d39d96832ae6 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a" returned: 0 in 0.324s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:23 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a is being set with open permissions: ugo+rw
Sep 29 18:30:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:23 devstack sudo[104119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a
Sep 29 18:30:23 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:24 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a" returned: 0 in 0.271s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:24 devstack sudo[104122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.info
Sep 29 18:30:24 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:24 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.info" returned: 0 in 0.285s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:24 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.info is being set with open permissions: ugo+rw
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:24 devstack sudo[104126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.info
Sep 29 18:30:24 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:24 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.info" returned: 0 in 0.279s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-a7437209-a33f-4d44-ae78-18d08e9d2961 req-b4f48293-42aa-4d7a-a318-3c91063d35db tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.830s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-a7437209-a33f-4d44-ae78-18d08e9d2961 req-b4f48293-42aa-4d7a-a318-3c91063d35db tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.580s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] Creating offline snapshot dcdb9cb2-1306-4151-9715-fe3147091b6a of volume b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:30:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-23c2c5d2-b841-4974-854d-c40a7b3a83fa tempest-CinderUnicodeTest-1383702246 None] Create snapshot completed successfully
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[76283b80-fc57-417e-a9fc-bf2ddc01b871]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-a7437209-a33f-4d44-ae78-18d08e9d2961 req-b4f48293-42aa-4d7a-a318-3c91063d35db tempest-TestServerVolumeAttachmentScenario-189532627 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-865d5a39-e724-408c-b49e-260e61ae16b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80854450-d91c-4cea-91fe-aeac27fca691', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:30:25 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-a7437209-a33f-4d44-ae78-18d08e9d2961 req-b4f48293-42aa-4d7a-a318-3c91063d35db tempest-TestServerVolumeAttachmentScenario-189532627 None] attachment_update completed successfully.
Sep 29 18:30:25 devstack sudo[104129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0
Sep 29 18:30:25 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "cinder-0494dcb2-6e08-419a-82a2-ba0acbe4802a-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-0494dcb2-6e08-419a-82a2-ba0acbe4802a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "cinder-quobyte-3f7c975e-c189-495e-993d-d39d96832ae6" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-quobyte-3f7c975e-c189-495e-993d-d39d96832ae6" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "cinder-quobyte-0494dcb2-6e08-419a-82a2-ba0acbe4802a" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-quobyte-0494dcb2-6e08-419a-82a2-ba0acbe4802a" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Deleting offline snapshot 0494dcb2-6e08-419a-82a2-ba0acbe4802a of volume 3f7c975e-c189-495e-993d-d39d96832ae6 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] snapshot_file for this snap is: volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df47efbd-97fd-4e2a-b3e1-c1c24cf0c03c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:25 devstack sudo[104208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a
Sep 29 18:30:25 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:25 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0" returned: 0 in 0.671s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97767f5-50cf-4abf-8180-9cce61de7702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:25 devstack sudo[104552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a 1G
Sep 29 18:30:25 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:25 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a" returned: 0 in 0.590s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f7c975e-c189-495e-993d-d39d96832ae6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:30:26 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24c3125-6e9e-4b65-bba0-5da5bdc69c6f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:26 devstack sudo[104563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6
Sep 29 18:30:26 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:26 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a 1G" returned: 0 in 0.768s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:26 devstack sudo[104566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a
Sep 29 18:30:26 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:26 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6" returned: 0 in 0.591s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:26 devstack sudo[104571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a
Sep 29 18:30:26 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:26 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a" returned: 0 in 0.377s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:26 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a is being set with open permissions: ugo+rw
Sep 29 18:30:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:26 devstack sudo[104576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a
Sep 29 18:30:26 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:27 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a" returned: 0 in 0.402s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:27 devstack sudo[104582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a
Sep 29 18:30:27 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:27 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a" returned: 0 in 0.301s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-254b5c86-bd8e-4c09-b2be-c9a4a923a626 tempest-VolumesSnapshotListTestJSON-1307372882 None] Create snapshot completed successfully
Sep 29 18:30:27 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6.0494dcb2-6e08-419a-82a2-ba0acbe4802a" returned: 0 in 0.276s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-quobyte-0494dcb2-6e08-419a-82a2-ba0acbe4802a" released by "_delete_snapshot" :: held 2.051s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-quobyte-3f7c975e-c189-495e-993d-d39d96832ae6" released by "delete_snapshot" :: held 2.098s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Created reservations ['56f7fdb0-f90b-48b4-9e24-56f018152696', 'fbe1149c-3880-431f-8d6f-d60706d99643', 'bf30a8f3-dfc5-41f8-ac01-22346e70a649', '7d81c449-e328-4c5a-925b-ebf264b5d711'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Delete snapshot completed successfully.
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6f382825-8f9d-4ff7-882d-af84c1cdd62f tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-0494dcb2-6e08-419a-82a2-ba0acbe4802a-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] Creating offline snapshot 41fc8e8e-36fc-4bc9-9a57-649c5a9df444 of volume b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11d12b5-5511-44d2-9eb7-c84d5a1d54a8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:27 devstack sudo[104620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a
Sep 29 18:30:27 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:28 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a" returned: 0 in 0.562s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97767f5-50cf-4abf-8180-9cce61de7702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:30:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:28 devstack sudo[104628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444 1G
Sep 29 18:30:28 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "cinder-3f7c975e-c189-495e-993d-d39d96832ae6-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:29 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444 1G" returned: 0 in 0.637s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-3f7c975e-c189-495e-993d-d39d96832ae6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:29 devstack sudo[104634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444
Sep 29 18:30:29 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "cinder-quobyte-3f7c975e-c189-495e-993d-d39d96832ae6" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-quobyte-3f7c975e-c189-495e-993d-d39d96832ae6" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dbc2e5-acac-4b7c-8450-0c52df889982]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Flow 'volume_create_manager' (86362a61-af41-4e2f-9899-980a7ff1820d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd8e2c2-6a15-46a3-8deb-35d24dd9b7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd8e2c2-6a15-46a3-8deb-35d24dd9b7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-851339386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552cc95e-5beb-4904-8269-58b95a7af6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10188037302a41f1a741fcf3e31fb5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:29Z,use_quota=True,user_id='9a740ef9bd8443fc911eea7a7aa6da20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10d6b62-e3f2-467d-a345-d671bd77aa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10d6b62-e3f2-467d-a345-d671bd77aa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c322eb19-5427-4fd8-b588-ac442a19fcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c322eb19-5427-4fd8-b588-ac442a19fcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '552cc95e-5beb-4904-8269-58b95a7af6a3', 'volume_name': 'volume-552cc95e-5beb-4904-8269-58b95a7af6a3', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a66363-7ff9-4695-aefe-be17081a7d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a66363-7ff9-4695-aefe-be17081a7d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:29 devstack sudo[104636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6
Sep 29 18:30:29 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dc4874-1f84-4b54-a845-6914deee9fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:29 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Volume 552cc95e-5beb-4904-8269-58b95a7af6a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-552cc95e-5beb-4904-8269-58b95a7af6a3', 'volume_size': 1}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:29 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444" returned: 0 in 0.587s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:29 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444 is being set with open permissions: ugo+rw
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:29 devstack sudo[104641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444
Sep 29 18:30:29 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Flow 'volume_create_manager' (1f770f83-dfe5-4e24-8f0c-bdbb9608cc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f623140f-8c90-4dbd-af66-c56353cac422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:29 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6" returned: 0 in 0.687s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f623140f-8c90-4dbd-af66-c56353cac422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2063389453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5e33f5-6e26-40c3-bc72-a9e17257d526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10188037302a41f1a741fcf3e31fb5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:30Z,use_quota=True,user_id='9a740ef9bd8443fc911eea7a7aa6da20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff92b7c-f5bc-4d12-8ac8-287383a3d1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:29 devstack sudo[104647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6
Sep 29 18:30:29 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff92b7c-f5bc-4d12-8ac8-287383a3d1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29e215f-9fb4-43cf-a476-ba42cfb6a858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29e215f-9fb4-43cf-a476-ba42cfb6a858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5e33f5-6e26-40c3-bc72-a9e17257d526', 'volume_name': 'volume-af5e33f5-6e26-40c3-bc72-a9e17257d526', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:29 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37252cda-f2df-4fee-b34b-a472d113f660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37252cda-f2df-4fee-b34b-a472d113f660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604fd780-3fca-4a3d-884d-a20477e72dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:29 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Volume af5e33f5-6e26-40c3-bc72-a9e17257d526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5e33f5-6e26-40c3-bc72-a9e17257d526', 'volume_size': 1}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444" returned: 0 in 0.366s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.305s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-851339386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552cc95e-5beb-4904-8269-58b95a7af6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10188037302a41f1a741fcf3e31fb5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:29Z,use_quota=True,user_id='9a740ef9bd8443fc911eea7a7aa6da20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Creating volume 552cc95e-5beb-4904-8269-58b95a7af6a3 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:30 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-87f5e884-799e-4bf6-9026-9798b609b0fd tempest-VolumesSnapshotListTestJSON-1307372882 None] Create snapshot completed successfully
Sep 29 18:30:30 devstack sudo[104649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3 1073741824
Sep 29 18:30:30 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:30 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-3f7c975e-c189-495e-993d-d39d96832ae6" returned: 0 in 0.421s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-quobyte-3f7c975e-c189-495e-993d-d39d96832ae6" released by "delete_volume" :: held 1.231s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Flow 'volume_create_manager' (a4ffc55f-5cba-4bfc-8e75-03f0f750b5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158b0964-7dee-4c1c-b592-05a3696e6a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158b0964-7dee-4c1c-b592-05a3696e6a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-72050511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4da54e-f6af-4c46-9332-fbbf56e1b38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10188037302a41f1a741fcf3e31fb5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:30Z,use_quota=True,user_id='9a740ef9bd8443fc911eea7a7aa6da20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f29cf1-99bf-41a6-9efb-bfdebbb08586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f29cf1-99bf-41a6-9efb-bfdebbb08586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfefe70-3050-4b6f-95b6-054a2ec549d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfefe70-3050-4b6f-95b6-054a2ec549d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c4da54e-f6af-4c46-9332-fbbf56e1b38c', 'volume_name': 'volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a216e8cd-2fc6-4fa8-9faa-c1a72af64f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a216e8cd-2fc6-4fa8-9faa-c1a72af64f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42601866-655a-42a4-af3c-fa1ed9dda1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:30 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Volume 8c4da54e-f6af-4c46-9332-fbbf56e1b38c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c', 'volume_size': 1}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Created reservations ['f749abd8-85a0-4997-80d2-760fd0c25aa4', '8540ebd5-e145-4b16-817c-d458c6118670', '6b397557-e1a8-4233-b083-98e1d5eee1bc', 'ad37dd2d-949f-49f0-bc21-f660042a8b2f'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:30 devstack sudo[104655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:30 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:30 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3 1073741824" returned: 0 in 0.833s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:31 devstack sudo[104660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3
Sep 29 18:30:31 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Flow 'volume_create_manager' (91961c36-be22-4234-800b-a8007b563cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8b893a-6d70-4a71-bec7-2ae47dc61167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8b893a-6d70-4a71-bec7-2ae47dc61167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1656146004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bc28b2-4223-4456-a954-786de499c44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10188037302a41f1a741fcf3e31fb5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:31Z,use_quota=True,user_id='9a740ef9bd8443fc911eea7a7aa6da20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f7b3f4-7705-4d11-826a-c0526ddfc8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f7b3f4-7705-4d11-826a-c0526ddfc8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f9ac03-dcaf-40bb-9354-6875304a595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f9ac03-dcaf-40bb-9354-6875304a595f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2bc28b2-4223-4456-a954-786de499c44a', 'volume_name': 'volume-c2bc28b2-4223-4456-a954-786de499c44a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e90de5-009d-4544-ad01-a54ff2e88477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e90de5-009d-4544-ad01-a54ff2e88477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32570dc0-3ee4-47bd-b987-f86dc5bd8123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:31 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Volume c2bc28b2-4223-4456-a954-786de499c44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2bc28b2-4223-4456-a954-786de499c44a', 'volume_size': 1}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:31 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.554s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Deleted volume successfully.
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-61eb37f7-8452-4d80-a91c-cf8f23899202 tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-3f7c975e-c189-495e-993d-d39d96832ae6-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:31 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3" returned: 0 in 0.403s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2063389453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5e33f5-6e26-40c3-bc72-a9e17257d526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10188037302a41f1a741fcf3e31fb5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:30Z,use_quota=True,user_id='9a740ef9bd8443fc911eea7a7aa6da20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Creating volume af5e33f5-6e26-40c3-bc72-a9e17257d526 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:31 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dc4874-1f84-4b54-a845-6914deee9fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-552cc95e-5beb-4904-8269-58b95a7af6a3', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130527f9-a9ed-4c61-a2be-a015a7b4fc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:31 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Volume volume-552cc95e-5beb-4904-8269-58b95a7af6a3 (552cc95e-5beb-4904-8269-58b95a7af6a3): created successfully
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130527f9-a9ed-4c61-a2be-a015a7b4fc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:31 devstack sudo[104670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526 1073741824
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Flow 'volume_create_manager' (86362a61-af41-4e2f-9899-980a7ff1820d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:31 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-90687633-c2e7-480b-92be-ed0bdc865eac tempest-CreateVolumesFromImageTest-1029051488 None] Created volume successfully.
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "cinder-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "cinder-quobyte-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-quobyte-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e" acquired by "delete_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66f6eaa-2235-4134-a5c6-5880be4abbca]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Flow 'volume_create_manager' (3bcc4e50-bd8a-46d7-9ecc-ee083fc435a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d3f6e2-33b1-4024-8b33-24d32394c84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d3f6e2-33b1-4024-8b33-24d32394c84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-651787563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036d95c0-1533-4f78-a1a0-0be10915b788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10188037302a41f1a741fcf3e31fb5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:32Z,use_quota=True,user_id='9a740ef9bd8443fc911eea7a7aa6da20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcddb2a-09af-40a1-bdb4-7758f7e1620f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcddb2a-09af-40a1-bdb4-7758f7e1620f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dae6de-2b65-4d88-add8-afb19ee5d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dae6de-2b65-4d88-add8-afb19ee5d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036d95c0-1533-4f78-a1a0-0be10915b788', 'volume_name': 'volume-036d95c0-1533-4f78-a1a0-0be10915b788', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e033fe-dcae-4af1-a270-45aa83291290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e033fe-dcae-4af1-a270-45aa83291290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682d3ae4-8f7b-4881-9009-fc201881a77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:31 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Volume 036d95c0-1533-4f78-a1a0-0be10915b788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036d95c0-1533-4f78-a1a0-0be10915b788', 'volume_size': 1}
Sep 29 18:30:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:31 devstack sudo[104672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e
Sep 29 18:30:31 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:32 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526 1073741824" returned: 0 in 0.778s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:32 devstack sudo[104680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526
Sep 29 18:30:32 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:32 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e" returned: 0 in 0.588s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:32 devstack sudo[104683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e
Sep 29 18:30:32 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "cinder-41fc8e8e-36fc-4bc9-9a57-649c5a9df444-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-41fc8e8e-36fc-4bc9-9a57-649c5a9df444-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "cinder-quobyte-41fc8e8e-36fc-4bc9-9a57-649c5a9df444" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:32 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526" returned: 0 in 0.367s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-41fc8e8e-36fc-4bc9-9a57-649c5a9df444" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Deleting offline snapshot 41fc8e8e-36fc-4bc9-9a57-649c5a9df444 of volume b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] snapshot_file for this snap is: volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.087s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-72050511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4da54e-f6af-4c46-9332-fbbf56e1b38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10188037302a41f1a741fcf3e31fb5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:30Z,use_quota=True,user_id='9a740ef9bd8443fc911eea7a7aa6da20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Creating volume 8c4da54e-f6af-4c46-9332-fbbf56e1b38c {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:32 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4426cfe5-6cb3-461b-bc00-41e12716bc87]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604fd780-3fca-4a3d-884d-a20477e72dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5e33f5-6e26-40c3-bc72-a9e17257d526', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:32 devstack sudo[104695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c 1073741824
Sep 29 18:30:32 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bcbc29-f31b-4994-9c02-35a493795f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:32 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e" returned: 0 in 0.367s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:32 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Volume volume-af5e33f5-6e26-40c3-bc72-a9e17257d526 (af5e33f5-6e26-40c3-bc72-a9e17257d526): created successfully
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bcbc29-f31b-4994-9c02-35a493795f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Flow 'volume_create_manager' (1f770f83-dfe5-4e24-8f0c-bdbb9608cc84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-quobyte-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e" released by "delete_volume" :: held 1.084s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:32 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3b9fca7d-33ce-41a0-a13c-36f784a24ec7 tempest-CreateVolumesFromImageTest-1029051488 None] Created volume successfully.
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-e6a0b4a7-359d-4305-a477-9a53d2f52fcc req-ed0113e7-a70e-45ef-9c25-37e0e114b54e tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:32 devstack sudo[104697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444
Sep 29 18:30:32 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Created reservations ['19e594f0-f144-4797-b06f-90f47e3a386b', 'dc22e0eb-8e84-4a65-8f15-b110da72cd28', '8da405f6-2703-4086-b8eb-35cb9f7dc07e', '45b4a317-2bd0-4d82-8ba4-123fa5dab6e8'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:32 devstack sudo[104700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:32 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:33 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444" returned: 0 in 0.486s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97767f5-50cf-4abf-8180-9cce61de7702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f76ad78-08eb-4308-b45f-9b798643aada]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:33 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.319s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:33 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c 1073741824" returned: 0 in 0.614s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:33 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Deleted volume successfully.
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-930fb63d-8f53-4b59-ad68-85d8a3fd733a tempest-CinderUnicodeTest-1383702246 None] Lock "cinder-27a8493a-ef6f-4bc4-88f4-bf0afd5c474e-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:33 devstack sudo[104711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c
Sep 29 18:30:33 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:33 devstack sudo[104710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a
Sep 29 18:30:33 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:33 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c" returned: 0 in 0.270s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1656146004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bc28b2-4223-4456-a954-786de499c44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10188037302a41f1a741fcf3e31fb5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:31Z,use_quota=True,user_id='9a740ef9bd8443fc911eea7a7aa6da20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Creating volume c2bc28b2-4223-4456-a954-786de499c44a {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:33 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:33 devstack sudo[104718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a 1073741824
Sep 29 18:30:33 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42601866-655a-42a4-af3c-fa1ed9dda1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d165f6-60b3-4930-814a-04c226c63966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:33 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:33 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Volume volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c (8c4da54e-f6af-4c46-9332-fbbf56e1b38c): created successfully
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d165f6-60b3-4930-814a-04c226c63966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Flow 'volume_create_manager' (a4ffc55f-5cba-4bfc-8e75-03f0f750b5b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a" returned: 0 in 0.451s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97767f5-50cf-4abf-8180-9cce61de7702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:30:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:33 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-36c4c473-082e-4f4f-a5be-052303941d4a tempest-CreateVolumesFromImageTest-1029051488 None] Created volume successfully.
Sep 29 18:30:33 devstack sudo[104720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444
Sep 29 18:30:33 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:34 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a 1073741824" returned: 0 in 0.537s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:34 devstack sudo[104729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a
Sep 29 18:30:34 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:34 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444" returned: 0 in 0.551s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:34 devstack sudo[104731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444
Sep 29 18:30:34 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:34 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a" returned: 0 in 0.289s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.531s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-651787563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036d95c0-1533-4f78-a1a0-0be10915b788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10188037302a41f1a741fcf3e31fb5b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:32Z,use_quota=True,user_id='9a740ef9bd8443fc911eea7a7aa6da20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Creating volume 036d95c0-1533-4f78-a1a0-0be10915b788 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:34 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32570dc0-3ee4-47bd-b987-f86dc5bd8123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2bc28b2-4223-4456-a954-786de499c44a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:34 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d220c-b050-450b-b5f3-0b330245dbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:34 devstack sudo[104735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788 1073741824
Sep 29 18:30:34 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.41fc8e8e-36fc-4bc9-9a57-649c5a9df444" returned: 0 in 0.293s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-41fc8e8e-36fc-4bc9-9a57-649c5a9df444" released by "_delete_snapshot" :: held 1.934s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:34 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Volume volume-c2bc28b2-4223-4456-a954-786de499c44a (c2bc28b2-4223-4456-a954-786de499c44a): created successfully
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d220c-b050-450b-b5f3-0b330245dbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Flow 'volume_create_manager' (91961c36-be22-4234-800b-a8007b563cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" released by "delete_snapshot" :: held 1.994s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:34 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-b585c0bf-def8-419e-a17b-13bf80acde5c tempest-CreateVolumesFromImageTest-1029051488 None] Created volume successfully.
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Created reservations ['d7ef4cbc-3609-4494-9965-b5c8913f3435', '73b893e3-127b-410a-ae6e-ccd0ad43956a', '6e2b4219-1b38-41b6-9865-6b43e935e780', '219f504e-a5fd-448a-94c2-f5e91a3245ef'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:34 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Delete snapshot completed successfully.
Sep 29 18:30:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-558a1069-8c4f-44a4-96bc-7ae904d42e1e tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-41fc8e8e-36fc-4bc9-9a57-649c5a9df444-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:35 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788 1073741824" returned: 0 in 0.532s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:35 devstack sudo[104741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788
Sep 29 18:30:35 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:35 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788" returned: 0 in 0.312s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-e6a0b4a7-359d-4305-a477-9a53d2f52fcc req-ed0113e7-a70e-45ef-9c25-37e0e114b54e tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.581s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682d3ae4-8f7b-4881-9009-fc201881a77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036d95c0-1533-4f78-a1a0-0be10915b788', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe2d369-b24f-4aef-8f22-6c849a757d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-e6a0b4a7-359d-4305-a477-9a53d2f52fcc req-ed0113e7-a70e-45ef-9c25-37e0e114b54e tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:35 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Volume volume-036d95c0-1533-4f78-a1a0-0be10915b788 (036d95c0-1533-4f78-a1a0-0be10915b788): created successfully
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe2d369-b24f-4aef-8f22-6c849a757d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Flow 'volume_create_manager' (3bcc4e50-bd8a-46d7-9ecc-ee083fc435a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:35 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-aa5d8cc4-ab64-462e-8729-8fe4c82c0717 tempest-CreateVolumesFromImageTest-1029051488 None] Created volume successfully.
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-e6a0b4a7-359d-4305-a477-9a53d2f52fcc req-ed0113e7-a70e-45ef-9c25-37e0e114b54e tempest-TestServerVolumeAttachmentScenario-189532627 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-0733f047-c743-452d-8662-441d86c09396', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6645bbc-e751-4f03-b2a9-cec4c6aa1b91', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:30:35 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-e6a0b4a7-359d-4305-a477-9a53d2f52fcc req-ed0113e7-a70e-45ef-9c25-37e0e114b54e tempest-TestServerVolumeAttachmentScenario-189532627 None] attachment_update completed successfully.
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "cinder-dcdb9cb2-1306-4151-9715-fe3147091b6a-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-dcdb9cb2-1306-4151-9715-fe3147091b6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "cinder-quobyte-dcdb9cb2-1306-4151-9715-fe3147091b6a" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-dcdb9cb2-1306-4151-9715-fe3147091b6a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Deleting offline snapshot dcdb9cb2-1306-4151-9715-fe3147091b6a of volume b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] snapshot_file for this snap is: volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f7719a-a947-45fd-8b76-5e94c0357342]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:35 devstack sudo[104749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a
Sep 29 18:30:35 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:36 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a" returned: 0 in 0.443s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97767f5-50cf-4abf-8180-9cce61de7702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80b25e3-037d-4808-aa14-9baa48a63abe]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "cinder-036d95c0-1533-4f78-a1a0-0be10915b788-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-036d95c0-1533-4f78-a1a0-0be10915b788-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:36 devstack sudo[104754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0
Sep 29 18:30:36 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "cinder-quobyte-036d95c0-1533-4f78-a1a0-0be10915b788" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-quobyte-036d95c0-1533-4f78-a1a0-0be10915b788" acquired by "delete_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad567c9-eee8-4e62-851d-d673cc71fb99]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:36 devstack sudo[104756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788
Sep 29 18:30:36 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:36 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0" returned: 0 in 0.415s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97767f5-50cf-4abf-8180-9cce61de7702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:36 devstack sudo[104761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a
Sep 29 18:30:36 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:36 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788" returned: 0 in 0.414s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:36 devstack sudo[104768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788
Sep 29 18:30:36 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:37 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a" returned: 0 in 0.431s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:37 devstack sudo[104772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a
Sep 29 18:30:37 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:37 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-036d95c0-1533-4f78-a1a0-0be10915b788" returned: 0 in 0.316s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-quobyte-036d95c0-1533-4f78-a1a0-0be10915b788" released by "delete_volume" :: held 0.787s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Created reservations ['13642fda-9c8d-4e51-9aec-6c99d1826ea3', '9831269d-bd5b-4bb0-8e04-4bf07074e9f2', 'a0e57ad8-165e-4010-8280-b34acbdc41da', 'f68d0e3b-aefd-4c1e-ad1c-b9a150bbf5cf'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:37 devstack sudo[104777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:37 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:37 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.dcdb9cb2-1306-4151-9715-fe3147091b6a" returned: 0 in 0.319s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-dcdb9cb2-1306-4151-9715-fe3147091b6a" released by "_delete_snapshot" :: held 1.737s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" released by "delete_snapshot" :: held 1.766s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Created reservations ['4f3b2201-3b3b-4382-b8a8-f492f0733ca0', '2a42dbef-5789-4b1c-bf3c-e4d7a1d8c21e', '527d937b-0b07-44de-8627-c425c10369d5', '39279bff-314c-433d-99b4-e3115b4d9ecc'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "cinder-c2bc28b2-4223-4456-a954-786de499c44a-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-c2bc28b2-4223-4456-a954-786de499c44a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Delete snapshot completed successfully.
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "cinder-quobyte-c2bc28b2-4223-4456-a954-786de499c44a" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-41cd6cd2-c3cf-4b92-94d7-5eec8a7bec6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-dcdb9cb2-1306-4151-9715-fe3147091b6a-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-quobyte-c2bc28b2-4223-4456-a954-786de499c44a" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9352f9ad-4f0f-4ab1-88b6-15890e7f7dd0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:37 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.351s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Deleted volume successfully.
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5228ed4b-ead7-40cd-9a07-730be7f971f5 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-036d95c0-1533-4f78-a1a0-0be10915b788-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:37 devstack sudo[104784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "cinder-f9adcc7b-54ac-4aa4-a92e-2842d529d7e0-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:37 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-f9adcc7b-54ac-4aa4-a92e-2842d529d7e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-bcc19444-f0f1-468d-8b5c-08b55871501e req-63403a9f-63c5-49a5-950f-50e7cfad822a tempest-TestServerVolumeAttachmentScenario-189532627 None] Terminate volume connection completed successfully.
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-bcc19444-f0f1-468d-8b5c-08b55871501e req-63403a9f-63c5-49a5-950f-50e7cfad822a tempest-TestServerVolumeAttachmentScenario-189532627 None] Deleting attachment c6645bbc-e751-4f03-b2a9-cec4c6aa1b91. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "cinder-quobyte-f9adcc7b-54ac-4aa4-a92e-2842d529d7e0" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-f9adcc7b-54ac-4aa4-a92e-2842d529d7e0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Deleting offline snapshot f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 of volume b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] snapshot_file for this snap is: volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[199b1c28-d9e3-477b-a18c-5fbde1dadb30]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:38 devstack sudo[104787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0
Sep 29 18:30:38 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:38 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a" returned: 0 in 0.433s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:38 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a
Sep 29 18:30:38 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:38 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0" returned: 0 in 0.435s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97767f5-50cf-4abf-8180-9cce61de7702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:30:38 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2bc28b2-4223-4456-a954-786de499c44a" returned: 0 in 0.286s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[652cc2c0-6b63-4d57-ad8a-d6796fb514cf]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-quobyte-c2bc28b2-4223-4456-a954-786de499c44a" released by "delete_volume" :: held 0.785s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Created reservations ['2c530f60-92de-45a3-a505-8139a2a266ae', '4d8b0cd4-b395-4c4b-b592-cd5626a62f82', '253d3a57-9a9e-482d-8f0b-42608827e51b', 'ad7471c5-3b07-484d-a7ce-c1f1bb0d8abb'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:38 devstack sudo[104798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702
Sep 29 18:30:38 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:38 devstack sudo[104800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:38 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "cinder-8c4da54e-f6af-4c46-9332-fbbf56e1b38c-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-8c4da54e-f6af-4c46-9332-fbbf56e1b38c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:39 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.347s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "cinder-quobyte-8c4da54e-f6af-4c46-9332-fbbf56e1b38c" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:39 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Deleted volume successfully.
Sep 29 18:30:39 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702" returned: 0 in 0.532s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-quobyte-8c4da54e-f6af-4c46-9332-fbbf56e1b38c" acquired by "delete_volume" :: waited 0.041s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:39 devstack sudo[104806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0
Sep 29 18:30:39 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ff81162e-a3b5-41c4-87cb-8e91c189fdcf tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-c2bc28b2-4223-4456-a954-786de499c44a-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d41fe1e-994f-4929-bc2f-1ef055b4d0a3]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:39 devstack sudo[104808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c
Sep 29 18:30:39 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:39 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0" returned: 0 in 0.351s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:39 devstack sudo[104817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0
Sep 29 18:30:39 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:39 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-cfc6e9e6-c310-40fe-af50-0624132d8744 req-78ed42af-8b76-4be5-afce-71226bc95a84 tempest-TestServerVolumeAttachmentScenario-189532627 None] Terminate volume connection completed successfully.
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-cfc6e9e6-c310-40fe-af50-0624132d8744 req-78ed42af-8b76-4be5-afce-71226bc95a84 tempest-TestServerVolumeAttachmentScenario-189532627 None] Deleting attachment 80854450-d91c-4cea-91fe-aeac27fca691. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:30:39 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c" returned: 0 in 0.456s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:39 devstack sudo[104848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c
Sep 29 18:30:39 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:39 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702.f9adcc7b-54ac-4aa4-a92e-2842d529d7e0" returned: 0 in 0.310s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-f9adcc7b-54ac-4aa4-a92e-2842d529d7e0" released by "_delete_snapshot" :: held 1.766s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" released by "delete_snapshot" :: held 1.799s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Created reservations ['ed7c3515-adeb-4610-b372-b057fcbad533', 'e4b1c806-ee80-4389-a585-5d1f2ceae2be', '96610d29-954a-4819-ac8e-2e47740e9d2f', '8fc26c21-f11c-4a24-b7b7-77bc9a4b1488'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:39 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8c4da54e-f6af-4c46-9332-fbbf56e1b38c" returned: 0 in 0.284s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-quobyte-8c4da54e-f6af-4c46-9332-fbbf56e1b38c" released by "delete_volume" :: held 0.809s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:39 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Delete snapshot completed successfully.
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d78f7f3c-2bab-43f2-b679-bbb748845652 tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-f9adcc7b-54ac-4aa4-a92e-2842d529d7e0-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Created reservations ['1e4e1e2d-0966-423c-9117-9dc3951025aa', '9bb3e4af-20c1-4d78-81c8-ad0b0a8d3844', 'cc52f712-4c3a-4255-b2b8-98c2b8d1a699', 'bdca0a19-63dc-4559-a91d-98f9f22416fc'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:40 devstack sudo[104852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:40 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "cinder-af5e33f5-6e26-40c3-bc72-a9e17257d526-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-af5e33f5-6e26-40c3-bc72-a9e17257d526-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "cinder-quobyte-af5e33f5-6e26-40c3-bc72-a9e17257d526" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "cinder-b97767f5-50cf-4abf-8180-9cce61de7702-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-quobyte-af5e33f5-6e26-40c3-bc72-a9e17257d526" acquired by "delete_volume" :: waited 0.047s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-b97767f5-50cf-4abf-8180-9cce61de7702-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b14e179-c058-43af-a144-a5c493f3b5d6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:40 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.396s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Deleted volume successfully.
Sep 29 18:30:40 devstack sudo[104854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526
Sep 29 18:30:40 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55a43ed-c75a-43f5-95d8-2d5eea0e979a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-90b7efcc-e518-4b58-963e-bddbd6722c18 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-8c4da54e-f6af-4c46-9332-fbbf56e1b38c-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:40 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702
Sep 29 18:30:40 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:40 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526" returned: 0 in 0.470s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:40 devstack sudo[104863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526
Sep 29 18:30:40 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:40 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702" returned: 0 in 0.501s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:40 devstack sudo[104872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702
Sep 29 18:30:40 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:41 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-af5e33f5-6e26-40c3-bc72-a9e17257d526" returned: 0 in 0.319s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-quobyte-af5e33f5-6e26-40c3-bc72-a9e17257d526" released by "delete_volume" :: held 0.877s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Created reservations ['f397339e-d688-49b7-9828-ed1d84ed8d4a', 'fa992bf9-16cf-4fdd-94f3-83714b66f718', '59142122-c886-4a3a-ab24-3f7fea03d05a', '505f4893-099c-4051-a037-4b863ebb54d5'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:41 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b97767f5-50cf-4abf-8180-9cce61de7702" returned: 0 in 0.487s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:41 devstack sudo[104896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:41 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-quobyte-b97767f5-50cf-4abf-8180-9cce61de7702" released by "delete_volume" :: held 1.091s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Created reservations ['47fd5aa0-f20e-4a71-961f-339bdb327353', '4ee60671-4888-4035-ada0-dc605be0524c', 'ff5b8ae8-5deb-44a7-ae1d-909b973408f4', 'f904cb80-8426-47e9-9794-c6f2a9bfd68c'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:41 devstack sudo[104898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:41 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:41 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.310s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:41 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Deleted volume successfully.
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c4698c3d-85ce-4556-b7be-8177ad09ffc8 tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-af5e33f5-6e26-40c3-bc72-a9e17257d526-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:41 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.289s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:41 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Deleted volume successfully.
Sep 29 18:30:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fbd69f97-9f6a-4437-9017-980ac997ea6a tempest-VolumesSnapshotListTestJSON-1307372882 None] Lock "cinder-b97767f5-50cf-4abf-8180-9cce61de7702-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "cinder-552cc95e-5beb-4904-8269-58b95a7af6a3-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-552cc95e-5beb-4904-8269-58b95a7af6a3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "cinder-quobyte-552cc95e-5beb-4904-8269-58b95a7af6a3" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-quobyte-552cc95e-5beb-4904-8269-58b95a7af6a3" acquired by "delete_volume" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:42 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a52bfd-9a90-4de2-a491-76bd5393afc1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:42 devstack sudo[104905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3
Sep 29 18:30:42 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:43 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3" returned: 0 in 0.449s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:43 devstack sudo[104912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3
Sep 29 18:30:43 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:43 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-552cc95e-5beb-4904-8269-58b95a7af6a3" returned: 0 in 0.352s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-quobyte-552cc95e-5beb-4904-8269-58b95a7af6a3" released by "delete_volume" :: held 0.859s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Created reservations ['34e0e4c5-ba7b-45d6-a4cb-572cfa6a660f', '54b25a2d-7bcb-4c0b-bf7a-11d818ea2086', 'ca520058-32e0-482d-8428-0f4c4afc25e7', '88287d95-fc9c-4d96-82f1-fec2c20b249a'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:43 devstack sudo[104915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:43 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:43 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:43 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Deleted volume successfully.
Sep 29 18:30:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5f526c81-7080-4b5e-93c2-154b0a58ab2f tempest-CreateVolumesFromImageTest-1029051488 None] Lock "cinder-552cc95e-5beb-4904-8269-58b95a7af6a3-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "cinder-0733f047-c743-452d-8662-441d86c09396-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "cinder-0733f047-c743-452d-8662-441d86c09396-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "cinder-quobyte-0733f047-c743-452d-8662-441d86c09396" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "cinder-quobyte-0733f047-c743-452d-8662-441d86c09396" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:45 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125f733-ba8a-4cc0-b0d0-1e171378280a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:45 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396
Sep 29 18:30:45 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:46 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396" returned: 0 in 0.443s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:46 devstack sudo[104925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396
Sep 29 18:30:46 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:46 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0733f047-c743-452d-8662-441d86c09396" returned: 0 in 0.283s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "cinder-quobyte-0733f047-c743-452d-8662-441d86c09396" released by "delete_volume" :: held 0.787s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Created reservations ['6740d347-3ecc-4a88-8a01-0a4c49e5b47e', '4013ba29-db9a-4135-9dc2-393ff0b3a031', 'a394f6f2-f080-4a6b-9265-b1aae94598c7', '1fdd968c-5f46-448c-9535-8d43e6d7c2aa'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:46 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:46 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "cinder-865d5a39-e724-408c-b49e-260e61ae16b9-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "cinder-865d5a39-e724-408c-b49e-260e61ae16b9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "cinder-quobyte-865d5a39-e724-408c-b49e-260e61ae16b9" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "cinder-quobyte-865d5a39-e724-408c-b49e-260e61ae16b9" acquired by "delete_volume" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b486ef3-f1ac-436c-8520-248531b8994c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:47 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.425s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:47 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Deleted volume successfully.
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ba836c80-439b-4825-89fb-17f8d8870c7e tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "cinder-0733f047-c743-452d-8662-441d86c09396-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:47 devstack sudo[104931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9
Sep 29 18:30:47 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (c8756d82-e995-4e27-a9a3-2d5d52ed7fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689db477-57c4-4783-b1bd-47dceface528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689db477-57c4-4783-b1bd-47dceface528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-217157300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e278850-f31c-4275-b741-85cf993b04bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:47Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717ad2e3-11bc-4109-b2d0-384de2a04a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717ad2e3-11bc-4109-b2d0-384de2a04a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:47 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b49eac-9bdb-43a0-a07c-8bef79687bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b49eac-9bdb-43a0-a07c-8bef79687bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e278850-f31c-4275-b741-85cf993b04bd', 'volume_name': 'volume-6e278850-f31c-4275-b741-85cf993b04bd', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6a2eb7-ffca-4a97-abf9-0aae0ece449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6a2eb7-ffca-4a97-abf9-0aae0ece449d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad406dba-e1f6-4038-8c1b-b1121f382b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:47 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume 6e278850-f31c-4275-b741-85cf993b04bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e278850-f31c-4275-b741-85cf993b04bd', 'volume_size': 1}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-217157300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e278850-f31c-4275-b741-85cf993b04bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:47Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Creating volume 6e278850-f31c-4275-b741-85cf993b04bd {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:47 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9" returned: 0 in 0.555s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:47 devstack sudo[104936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd 1073741824
Sep 29 18:30:47 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:47 devstack sudo[104937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9
Sep 29 18:30:47 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:47 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-865d5a39-e724-408c-b49e-260e61ae16b9" returned: 0 in 0.261s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "cinder-quobyte-865d5a39-e724-408c-b49e-260e61ae16b9" released by "delete_volume" :: held 0.902s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Created reservations ['dbba6d9f-e03e-4981-b4a1-b48fee21c419', '2fdadc8d-64be-482f-9bdc-c6dd537da88c', 'a6e1b3b3-8961-4913-80a9-0b982707456f', 'ec68d157-6b78-499e-a618-a909e90c9145'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:48 devstack sudo[104945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:48 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:48 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd 1073741824" returned: 0 in 0.557s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:48 devstack sudo[104947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd
Sep 29 18:30:48 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:48 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.324s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:48 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Deleted volume successfully.
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-116bb704-c91f-40f3-9794-2c9c2e3ddb55 tempest-TestServerVolumeAttachmentScenario-189532627 None] Lock "cinder-865d5a39-e724-408c-b49e-260e61ae16b9-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:48 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd" returned: 0 in 0.293s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad406dba-e1f6-4038-8c1b-b1121f382b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e278850-f31c-4275-b741-85cf993b04bd', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a7adeb-7965-4d6c-a954-6d320e96f59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:48 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume volume-6e278850-f31c-4275-b741-85cf993b04bd (6e278850-f31c-4275-b741-85cf993b04bd): created successfully
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a7adeb-7965-4d6c-a954-6d320e96f59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (c8756d82-e995-4e27-a9a3-2d5d52ed7fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:48 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-93ed4e63-9c3b-43c5-b046-1c296a926de9 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created volume successfully.
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (fe021df8-77dc-4ea3-b554-04287089d754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3e4807-fb8a-4e84-b97a-d39df55052df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3e4807-fb8a-4e84-b97a-d39df55052df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1208113188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0c58db-518f-4629-94e5-15e2f181faf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:50Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b84f11-8b7c-4459-ba24-dd51959665fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b84f11-8b7c-4459-ba24-dd51959665fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d832b54-0f2e-4047-927e-c8a8bba9019e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d832b54-0f2e-4047-927e-c8a8bba9019e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d0c58db-518f-4629-94e5-15e2f181faf3', 'volume_name': 'volume-7d0c58db-518f-4629-94e5-15e2f181faf3', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5dbc24-0b2f-4b08-9361-c120f3ce1ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5dbc24-0b2f-4b08-9361-c120f3ce1ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920d05d8-692e-4fc8-9450-cdc517a5e880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:50 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume 7d0c58db-518f-4629-94e5-15e2f181faf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d0c58db-518f-4629-94e5-15e2f181faf3', 'volume_size': 1}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1208113188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0c58db-518f-4629-94e5-15e2f181faf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:50Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Creating volume 7d0c58db-518f-4629-94e5-15e2f181faf3 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:50 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:50 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3 1073741824
Sep 29 18:30:50 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (012ba909-9700-43e6-9fcd-86fded2940ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3af4072-7a4c-4b08-9bdc-12d7a71982e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3af4072-7a4c-4b08-9bdc-12d7a71982e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147295240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:51Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c5aba6-4028-4a15-a0cb-c2cea224dfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c5aba6-4028-4a15-a0cb-c2cea224dfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00098f1-ab8f-4dc4-a53d-0ff4d10a8aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00098f1-ab8f-4dc4-a53d-0ff4d10a8aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5', 'volume_name': 'volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e572bb1-774d-4d35-9457-37c0a5678236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e572bb1-774d-4d35-9457-37c0a5678236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0b264a-0a59-49d1-a9e4-655f0150dfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:50 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5', 'volume_size': 1}
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:50 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3 1073741824" returned: 0 in 0.766s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:51 devstack sudo[104957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3
Sep 29 18:30:51 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (f2ac3b65-a2be-45f4-be36-27b303cddf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daed4287-6280-457d-bd41-a407518b7379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daed4287-6280-457d-bd41-a407518b7379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519999311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d783a1e-66f1-4cf1-bc68-dde81b40ab2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:51Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c822173-904f-4c0d-9d02-1a1abc86b601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c822173-904f-4c0d-9d02-1a1abc86b601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe4b550-1f29-4a11-9fad-0197b7cf7282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe4b550-1f29-4a11-9fad-0197b7cf7282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d783a1e-66f1-4cf1-bc68-dde81b40ab2c', 'volume_name': 'volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60055a6-9efe-43fd-8bac-0c1f8ed8fd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60055a6-9efe-43fd-8bac-0c1f8ed8fd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe8c70a-baa4-46d0-a076-19f406df56d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:51 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume 5d783a1e-66f1-4cf1-bc68-dde81b40ab2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c', 'volume_size': 1}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:51 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3" returned: 0 in 0.362s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1147295240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:51Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Creating volume c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:51 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:51 devstack sudo[104960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5 1073741824
Sep 29 18:30:51 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920d05d8-692e-4fc8-9450-cdc517a5e880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0c58db-518f-4629-94e5-15e2f181faf3', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f164f41-6f50-4fb5-873a-3ca7f3334aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:51 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume volume-7d0c58db-518f-4629-94e5-15e2f181faf3 (7d0c58db-518f-4629-94e5-15e2f181faf3): created successfully
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f164f41-6f50-4fb5-873a-3ca7f3334aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (fe021df8-77dc-4ea3-b554-04287089d754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:51 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e992252a-7a0e-486d-8b64-2518e9985ab7 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created volume successfully.
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (042aa617-24ea-4758-b584-461f2e0ed12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12de972-8bb3-42c9-be97-04f8fdfa8885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12de972-8bb3-42c9-be97-04f8fdfa8885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188724847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e520492-b9f4-4ccb-a731-f01395086fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:52Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7183b1f-4b3f-40a9-a4f4-ca9339c86361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7183b1f-4b3f-40a9-a4f4-ca9339c86361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e9dac5-b25f-4cd9-bfb4-185591d3037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e9dac5-b25f-4cd9-bfb4-185591d3037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e520492-b9f4-4ccb-a731-f01395086fac', 'volume_name': 'volume-2e520492-b9f4-4ccb-a731-f01395086fac', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2b53ec-88db-451d-8817-bebc04258565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2b53ec-88db-451d-8817-bebc04258565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27cd9fc-6cf1-46af-9ab5-ff8845f26404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:51 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume 2e520492-b9f4-4ccb-a731-f01395086fac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e520492-b9f4-4ccb-a731-f01395086fac', 'volume_size': 1}
Sep 29 18:30:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (142e741c-5ad8-49b6-b1d9-2054106c6c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c36b995-222d-4219-8791-73adde74612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c36b995-222d-4219-8791-73adde74612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-198140000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20ed64f-5e31-4522-8be0-4aad6ab0aa41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:52Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd5e48b-6432-4702-9c4c-5a2f7ed78af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd5e48b-6432-4702-9c4c-5a2f7ed78af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb9aea1-8c7b-4aab-8c52-7d378e72e2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb9aea1-8c7b-4aab-8c52-7d378e72e2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a20ed64f-5e31-4522-8be0-4aad6ab0aa41', 'volume_name': 'volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4ba82e-eeea-4307-ab73-201c80c53e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4ba82e-eeea-4307-ab73-201c80c53e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7cf2f5-57a6-4b23-b521-0bc2244f92ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:52 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume a20ed64f-5e31-4522-8be0-4aad6ab0aa41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41', 'volume_size': 1}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:52 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5 1073741824" returned: 0 in 0.748s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:52 devstack sudo[104966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5
Sep 29 18:30:52 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:52 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5" returned: 0 in 0.300s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519999311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d783a1e-66f1-4cf1-bc68-dde81b40ab2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:51Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Creating volume 5d783a1e-66f1-4cf1-bc68-dde81b40ab2c {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:52 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0b264a-0a59-49d1-a9e4-655f0150dfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:52 devstack sudo[104969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c 1073741824
Sep 29 18:30:52 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00752fc-743b-4d3f-94a1-dd2185bc1675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:52 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5 (c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5): created successfully
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00752fc-743b-4d3f-94a1-dd2185bc1675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (012ba909-9700-43e6-9fcd-86fded2940ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:52 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3a7be2eb-68b0-433e-a354-6c75d4c8ecaa tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created volume successfully.
Sep 29 18:30:53 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c 1073741824" returned: 0 in 0.758s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:53 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c
Sep 29 18:30:53 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:53 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c" returned: 0 in 0.284s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.967s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188724847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e520492-b9f4-4ccb-a731-f01395086fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:52Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Creating volume 2e520492-b9f4-4ccb-a731-f01395086fac {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:53 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:53 devstack sudo[104979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac 1073741824
Sep 29 18:30:53 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe8c70a-baa4-46d0-a076-19f406df56d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cfa5a5-f4f6-479d-9e80-5bd9cf99e805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:53 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c (5d783a1e-66f1-4cf1-bc68-dde81b40ab2c): created successfully
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cfa5a5-f4f6-479d-9e80-5bd9cf99e805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (f2ac3b65-a2be-45f4-be36-27b303cddf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:53 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-cdacedae-78fa-4f71-9ffb-8300626833bc tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created volume successfully.
Sep 29 18:30:54 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac 1073741824" returned: 0 in 0.649s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:54 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac
Sep 29 18:30:54 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:54 devstack sudo[104987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:54 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:54 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac" returned: 0 in 0.357s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.598s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-198140000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20ed64f-5e31-4522-8be0-4aad6ab0aa41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b088dfd0b78b44e89bc1cbe608ef39d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:52Z,use_quota=True,user_id='22445da955f74b509c27cd571a448b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Creating volume a20ed64f-5e31-4522-8be0-4aad6ab0aa41 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:30:54 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:54 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.367s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27cd9fc-6cf1-46af-9ab5-ff8845f26404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e520492-b9f4-4ccb-a731-f01395086fac', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abfdcd8-1abb-4502-9ce2-bc4d43c6b32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:54 devstack sudo[104992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41 1073741824
Sep 29 18:30:54 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:54 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume volume-2e520492-b9f4-4ccb-a731-f01395086fac (2e520492-b9f4-4ccb-a731-f01395086fac): created successfully
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abfdcd8-1abb-4502-9ce2-bc4d43c6b32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (042aa617-24ea-4758-b584-461f2e0ed12e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a71af445-645c-41f5-857c-5e79e179c3ff tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created volume successfully.
Sep 29 18:30:55 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41 1073741824" returned: 0 in 0.583s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:55 devstack sudo[105000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41
Sep 29 18:30:55 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:55 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41" returned: 0 in 0.361s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:30:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7cf2f5-57a6-4b23-b521-0bc2244f92ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c81f16-c35a-416f-9c2b-d9d55e434cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:30:55 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Volume volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41 (a20ed64f-5e31-4522-8be0-4aad6ab0aa41): created successfully
Sep 29 18:30:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c81f16-c35a-416f-9c2b-d9d55e434cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:30:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Flow 'volume_create_manager' (142e741c-5ad8-49b6-b1d9-2054106c6c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:30:55 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2cbea0df-319d-48dd-a614-8dc119e73bc3 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created volume successfully.
Sep 29 18:30:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-a20ed64f-5e31-4522-8be0-4aad6ab0aa41-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-a20ed64f-5e31-4522-8be0-4aad6ab0aa41-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-quobyte-a20ed64f-5e31-4522-8be0-4aad6ab0aa41" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-a20ed64f-5e31-4522-8be0-4aad6ab0aa41" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:56 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[14293792-5aa1-4e98-9868-d2c9cc269067]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:56 devstack sudo[105003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41
Sep 29 18:30:56 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:57 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41" returned: 0 in 0.454s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:57 devstack sudo[105008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41
Sep 29 18:30:57 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:57 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a20ed64f-5e31-4522-8be0-4aad6ab0aa41" returned: 0 in 0.292s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-a20ed64f-5e31-4522-8be0-4aad6ab0aa41" released by "delete_volume" :: held 0.799s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created reservations ['ca9fbc63-ee52-40e8-9ecc-3d6d798a6140', 'f020e4d7-0265-4f1a-bbd7-032b9bf5a00b', '2642f770-6ba8-4744-aa47-63ea04e5d14b', '41ccdf70-8c53-4888-bcb2-d184f46adaf9'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:57 devstack sudo[105012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:57 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-2e520492-b9f4-4ccb-a731-f01395086fac-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-2e520492-b9f4-4ccb-a731-f01395086fac-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-quobyte-2e520492-b9f4-4ccb-a731-f01395086fac" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-2e520492-b9f4-4ccb-a731-f01395086fac" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:58 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[26174c0b-240b-4f18-b359-ba59fe1a5328]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:58 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.457s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:58 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:58 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Deleted volume successfully.
Sep 29 18:30:58 devstack sudo[105014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac
Sep 29 18:30:58 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-148ee046-4650-4d4f-8ee8-de5f903e616c tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-a20ed64f-5e31-4522-8be0-4aad6ab0aa41-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:58 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac" returned: 0 in 0.538s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:58 devstack sudo[105021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac
Sep 29 18:30:58 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:58 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2e520492-b9f4-4ccb-a731-f01395086fac" returned: 0 in 0.301s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-2e520492-b9f4-4ccb-a731-f01395086fac" released by "delete_volume" :: held 0.920s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created reservations ['0746b528-a58e-40aa-bea7-78f17336c659', 'e25731f4-80e5-47fb-a1c9-c8d62c4c1e9d', '9c4a882c-786d-4e4c-9677-75a94d5415e1', 'a116ba35-4025-407d-b10b-a228a2a8cd18'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:59 devstack sudo[105024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:30:59 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-quobyte-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c" acquired by "delete_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82f7282-b3b8-44ca-9d6a-ffd4fdf4d54f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:59 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.294s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:30:59 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Deleted volume successfully.
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bbf6970-d57a-4e63-9d2a-7c6eba0f05bd tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-2e520492-b9f4-4ccb-a731-f01395086fac-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:30:59 devstack sudo[105026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c
Sep 29 18:30:59 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:30:59 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c" returned: 0 in 0.431s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:30:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:30:59 devstack sudo[105032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c
Sep 29 18:30:59 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:00 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c" returned: 0 in 0.303s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c" released by "delete_volume" :: held 0.805s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created reservations ['c9fabce3-6c5c-40a3-a568-45ac119e526d', 'd6719bff-a1af-4cb8-b395-671b8d5edcec', '7d05fbd0-68d3-4ac4-8157-73412fe09e0f', '251bf45f-504f-4b66-b298-684ab49807f6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:00 devstack sudo[105035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:00 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-quobyte-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1dee2e-3fba-4141-b0e6-31ab8f4055c5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:00 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.362s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:00 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Deleted volume successfully.
Sep 29 18:31:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-985a8a77-c08e-4a68-a97f-8a8382d344ae tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-5d783a1e-66f1-4cf1-bc68-dde81b40ab2c-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:00 devstack sudo[105038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5
Sep 29 18:31:00 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:01 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5" returned: 0 in 0.452s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:01 devstack sudo[105044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5
Sep 29 18:31:01 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:01 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5" returned: 0 in 0.337s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5" released by "delete_volume" :: held 0.845s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created reservations ['49872be3-fd73-43a1-b5c8-0e3d2db6d0ab', 'be4f051f-0100-4f7c-becb-638000eb5fd6', 'ab141023-542f-43cb-812a-8feac461481b', 'ed860593-59d2-4c04-97e0-5ebb09e93477'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:01 devstack sudo[105048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:01 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-7d0c58db-518f-4629-94e5-15e2f181faf3-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-7d0c58db-518f-4629-94e5-15e2f181faf3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-quobyte-7d0c58db-518f-4629-94e5-15e2f181faf3" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-7d0c58db-518f-4629-94e5-15e2f181faf3" acquired by "delete_volume" :: waited 0.037s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b7fbf4-0793-4583-acb0-a1b0f2775395]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:02 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.343s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:02 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Deleted volume successfully.
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c3339742-a57c-407a-9a6b-7819141e8cf2 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-c6b12c00-3169-48e1-8ac5-fdf9a6ea11c5-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:02 devstack sudo[105051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3
Sep 29 18:31:02 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:02 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3" returned: 0 in 0.466s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:02 devstack sudo[105056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3
Sep 29 18:31:02 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:02 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d0c58db-518f-4629-94e5-15e2f181faf3" returned: 0 in 0.276s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-7d0c58db-518f-4629-94e5-15e2f181faf3" released by "delete_volume" :: held 0.808s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created reservations ['6e663d2f-fffa-4eaf-aad9-09f9db28a45f', 'a97fc0ea-2b0e-4cb1-86af-b1b6ad376157', '91e5bd85-3f32-4069-a284-ac4541787ff0', '27df4c99-4d5c-4b92-b50c-b54c7fa2e8d7'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:02 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:02 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-6e278850-f31c-4275-b741-85cf993b04bd-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-6e278850-f31c-4275-b741-85cf993b04bd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:03 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:03 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "cinder-quobyte-6e278850-f31c-4275-b741-85cf993b04bd" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:03 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Deleted volume successfully.
Sep 29 18:31:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-6e278850-f31c-4275-b741-85cf993b04bd" acquired by "delete_volume" :: waited 0.043s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0dfe94bc-6bb9-4ec4-80f7-0a7450fc1461 tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-7d0c58db-518f-4629-94e5-15e2f181faf3-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:03 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb7fe0d-e952-4140-b832-d9994f90e07f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:03 devstack sudo[105063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd
Sep 29 18:31:03 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:03 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd" returned: 0 in 0.483s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:03 devstack sudo[105068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd
Sep 29 18:31:03 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:04 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6e278850-f31c-4275-b741-85cf993b04bd" returned: 0 in 0.292s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-quobyte-6e278850-f31c-4275-b741-85cf993b04bd" released by "delete_volume" :: held 0.832s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Created reservations ['dbe41555-fd25-4569-9a9e-0d454ac757b4', '8e6d621b-978f-4143-ae27-f5e9bdb983c5', 'db9e0224-6f40-46b4-a9bb-263380e08488', 'b3350f2b-b876-40ea-b3f6-c7292f8e732c'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:04 devstack sudo[105072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:04 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:04 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.291s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:04 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Deleted volume successfully.
Sep 29 18:31:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-35f67bab-029b-4876-a4ca-99fab55f9d8d tempest-CreateVolumesFromSourceVolumeTest-137228001 None] Lock "cinder-6e278850-f31c-4275-b741-85cf993b04bd-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:10 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:31:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Flow 'volume_create_manager' (1e614901-1dcf-475b-84bb-701654d501e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0077123-2148-43b3-a31f-983f12bd29d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0077123-2148-43b3-a31f-983f12bd29d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5a673e-ebf7-4c63-bf96-20528cbbf41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d485a2bd874925a0d59290df757c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:11Z,use_quota=True,user_id='5d7197b3ec7643d0bb223c4fed87c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b69b365b-1e97-4da6-82ea-3f1693663c2e),volume_type_id=b69b365b-1e97-4da6-82ea-3f1693663c2e)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe80d05d-a20c-4bbe-b7b4-c0711722326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe80d05d-a20c-4bbe-b7b4-c0711722326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f39b86e-b612-4866-9874-faa7139d7e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:10 devstack cinder-volume[86821]: DEBUG cinder.image.glance [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Creating Keystone auth plugin from conf {{(pid=86821) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 18:31:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f39b86e-b612-4866-9874-faa7139d7e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'df5a673e-ebf7-4c63-bf96-20528cbbf41b', 'volume_name': 'volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b', 'volume_size': 1, 'image_id': '18400ae4-db9b-4240-a33e-fd7d9072d65c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18400ae4-db9b-4240-a33e-fd7d9072d65c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42a3a5f73019e2c3bf4b2670d2ad51da', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '99d485a2bd874925a0d59290df757c18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23567456e71b037d33d6b6ff3e4933a354426ef0fb7f463c4e9121f3d13e7fed127e9190432f4af365a99de5f8d7712ceed5263206944e30232e02205783d640', 'id': '18400ae4-db9b-4240-a33e-fd7d9072d65c', 'created_at': datetime.datetime(2026, 9, 29, 16, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 31, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18400ae4-db9b-4240-a33e-fd7d9072d65c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c482990>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604e0734-367f-4ca5-a46a-ea473217eb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604e0734-367f-4ca5-a46a-ea473217eb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8800d2a-509a-439e-b60b-f7d124e287ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:11 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Volume df5a673e-ebf7-4c63-bf96-20528cbbf41b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b', 'volume_size': 1, 'image_id': '18400ae4-db9b-4240-a33e-fd7d9072d65c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18400ae4-db9b-4240-a33e-fd7d9072d65c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42a3a5f73019e2c3bf4b2670d2ad51da', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '99d485a2bd874925a0d59290df757c18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23567456e71b037d33d6b6ff3e4933a354426ef0fb7f463c4e9121f3d13e7fed127e9190432f4af365a99de5f8d7712ceed5263206944e30232e02205783d640', 'id': '18400ae4-db9b-4240-a33e-fd7d9072d65c', 'created_at': datetime.datetime(2026, 9, 29, 16, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 31, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18400ae4-db9b-4240-a33e-fd7d9072d65c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c482990>}
Sep 29 18:31:11 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Trying to clone df5a673e-ebf7-4c63-bf96-20528cbbf41b from image 18400ae4-db9b-4240-a33e-fd7d9072d65c at location (None, [{'url': 'file:///opt/stack/data/glance/images/18400ae4-db9b-4240-a33e-fd7d9072d65c', 'metadata': {}}]). {{(pid=86821) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 18:31:11 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 18:31:11 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 18:31:11 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd7d301-dbb2-4a71-8f4d-38c5778f44e7]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:11 devstack sudo[105077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD
Sep 29 18:31:11 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:12 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:12 devstack sudo[105081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD
Sep 29 18:31:12 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:12 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:31:12 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Temporary image 18400ae4-db9b-4240-a33e-fd7d9072d65c is fetched for user 5d7197b3ec7643d0bb223c4fed87c8c8. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 18:31:12 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a72d0-b615-465a-b777-6c46303cdbc3]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:12 devstack sudo[105086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD
Sep 29 18:31:12 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:12 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Flow 'volume_create_manager' (7051d1aa-ca83-4c5c-bbac-df715946aa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7ac12e-69fa-440a-bdf0-5bf1a723366c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:13 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD
Sep 29 18:31:13 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7ac12e-69fa-440a-bdf0-5bf1a723366c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4a45b9-cabd-49f7-a1f4-a39b02ff08ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd80bb639314ef2906316d2bc0d8456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:13Z,use_quota=True,user_id='d145769d20c24f57b5fcff6cb526092e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff25d24-dc39-45b2-97e6-72a9a1c6ab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff25d24-dc39-45b2-97e6-72a9a1c6ab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0eeb3e5-a1c2-45aa-96f2-332ed007b2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.image.glance [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Creating Keystone auth plugin from conf {{(pid=86821) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 18:31:13 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5a673e-ebf7-4c63-bf96-20528cbbf41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d485a2bd874925a0d59290df757c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:11Z,use_quota=True,user_id='5d7197b3ec7643d0bb223c4fed87c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b69b365b-1e97-4da6-82ea-3f1693663c2e),volume_type_id=b69b365b-1e97-4da6-82ea-3f1693663c2e)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Creating volume df5a673e-ebf7-4c63-bf96-20528cbbf41b {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:31:13 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:13 devstack sudo[105096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b 1073741824
Sep 29 18:31:13 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0eeb3e5-a1c2-45aa-96f2-332ed007b2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db4a45b9-cabd-49f7-a1f4-a39b02ff08ac', 'volume_name': 'volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac', 'volume_size': 1, 'image_id': 'd767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6357277b823a5c8a7f2c27ae84070c03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'afd80bb639314ef2906316d2bc0d8456', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '519628607f80402a33c07d893873c6defdc3f3ad30d2a12bfb118e0e10cf6c9377065e4e0d9e589b4ba160d599cbb70cddbb48f65634c0649792cf62c8047530', 'id': 'd767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'created_at': datetime.datetime(2026, 9, 29, 16, 31, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 31, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d767a1cc-79b5-484a-8ed0-0d36d12f4caa/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c325760>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef4454-0475-4594-ba4e-6974ff26de74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef4454-0475-4594-ba4e-6974ff26de74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6230e2-1558-4ad6-9fd5-553e6882e4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:13 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Volume db4a45b9-cabd-49f7-a1f4-a39b02ff08ac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac', 'volume_size': 1, 'image_id': 'd767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6357277b823a5c8a7f2c27ae84070c03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'afd80bb639314ef2906316d2bc0d8456', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '519628607f80402a33c07d893873c6defdc3f3ad30d2a12bfb118e0e10cf6c9377065e4e0d9e589b4ba160d599cbb70cddbb48f65634c0649792cf62c8047530', 'id': 'd767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'created_at': datetime.datetime(2026, 9, 29, 16, 31, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 31, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d767a1cc-79b5-484a-8ed0-0d36d12f4caa/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c325760>}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Trying to clone db4a45b9-cabd-49f7-a1f4-a39b02ff08ac from image d767a1cc-79b5-484a-8ed0-0d36d12f4caa at location (None, [{'url': 'file:///opt/stack/data/glance/images/d767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'metadata': {}}]). {{(pid=86821) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 18:31:13 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2958397f-489b-4683-8a1d-f75d6adfe4c0]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:13 devstack sudo[105098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD
Sep 29 18:31:13 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:13 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b 1073741824" returned: 0 in 0.616s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:13 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:13 devstack sudo[105105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b
Sep 29 18:31:13 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:14 devstack sudo[105106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD
Sep 29 18:31:14 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:14 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b" returned: 0 in 0.261s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Attempting download of 18400ae4-db9b-4240-a33e-fd7d9072d65c ((None, [{'url': 'file:///opt/stack/data/glance/images/18400ae4-db9b-4240-a33e-fd7d9072d65c', 'metadata': {}}])) to volume df5a673e-ebf7-4c63-bf96-20528cbbf41b. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a444a58c-b889-4204-8fbb-6724f4c80b8c]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18400ae4-db9b-4240-a33e-fd7d9072d65c_y2cx7qa4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:14 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD" returned: 1 in 0.412s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Temporary image d767a1cc-79b5-484a-8ed0-0d36d12f4caa is fetched for user d145769d20c24f57b5fcff6cb526092e. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 18:31:14 devstack sudo[105110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18400ae4-db9b-4240-a33e-fd7d9072d65c_y2cx7qa4
Sep 29 18:31:14 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9e065b-9e24-4c34-bb94-0e6f8e6558ba]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Flow 'volume_create_manager' (62def1cc-d89f-480e-b455-5270b3c4f0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5d86e9-780f-4bd3-9f30-0c890eb8bd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5d86e9-780f-4bd3-9f30-0c890eb8bd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1782776306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d232991-050d-427e-8873-6a79073ee9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7606ca741e4e54aeaef193c3e6bc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:14Z,use_quota=True,user_id='b28bae13ad984d13bf0e7ae176776200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e155645-05bc-42ce-b1dc-61299c434283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e155645-05bc-42ce-b1dc-61299c434283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f304c84-4a27-473f-8b9b-cd8d77c051a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.image.glance [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Creating Keystone auth plugin from conf {{(pid=86821) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 18:31:14 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD
Sep 29 18:31:14 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:14 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18400ae4-db9b-4240-a33e-fd7d9072d65c_y2cx7qa4" returned: 0 in 0.360s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18400ae4-db9b-4240-a33e-fd7d9072d65c_y2cx7qa4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:14 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18400ae4-db9b-4240-a33e-fd7d9072d65c_y2cx7qa4
Sep 29 18:31:14 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f304c84-4a27-473f-8b9b-cd8d77c051a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9d232991-050d-427e-8873-6a79073ee9e3', 'volume_name': 'volume-9d232991-050d-427e-8873-6a79073ee9e3', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b968dd760>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:14 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c553e5a-82b2-4cf7-a22a-60ed08a06653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c553e5a-82b2-4cf7-a22a-60ed08a06653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecc50b7-e807-4e6a-a9a4-a3f008b49918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:14 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Volume 9d232991-050d-427e-8873-6a79073ee9e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9d232991-050d-427e-8873-6a79073ee9e3', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b968dd760>}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Trying to clone 9d232991-050d-427e-8873-6a79073ee9e3 from image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]). {{(pid=86821) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:15 devstack sudo[105123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD
Sep 29 18:31:15 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:15 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18400ae4-db9b-4240-a33e-fd7d9072d65c_y2cx7qa4" returned: 1 in 0.423s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18400ae4-db9b-4240-a33e-fd7d9072d65c_y2cx7qa4' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e81bd4b-07fd-4236-ab9a-086c6bbe72de]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:15 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD" returned: 1 in 0.393s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4a45b9-cabd-49f7-a1f4-a39b02ff08ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd80bb639314ef2906316d2bc0d8456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:13Z,use_quota=True,user_id='d145769d20c24f57b5fcff6cb526092e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Creating volume db4a45b9-cabd-49f7-a1f4-a39b02ff08ac {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:15 devstack sudo[105129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD
Sep 29 18:31:15 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:31:15 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:15 devstack sudo[105134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac 1073741824
Sep 29 18:31:15 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 18:31:15 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Image download 20.69 MB at 20.69 MB/s
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8fee35-89e2-4fa6-b22c-cb929bb9293f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:15 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:15 devstack sudo[105137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD
Sep 29 18:31:15 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:15 devstack sudo[105143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD
Sep 29 18:31:15 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:15 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac 1073741824" returned: 0 in 0.505s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:15 devstack sudo[105148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac
Sep 29 18:31:15 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:15 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Temporary image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb is fetched for user b28bae13ad984d13bf0e7ae176776200. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 18:31:15 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf87749a-00fe-41e1-b127-0b091b42b788]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] 18400ae4-db9b-4240-a33e-fd7d9072d65c was raw, converting to qcow2 {{(pid=86821) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 18:31:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:16 devstack sudo[105156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b
Sep 29 18:31:16 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:16 devstack sudo[105155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD
Sep 29 18:31:16 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:16 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac" returned: 0 in 0.280s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Attempting download of d767a1cc-79b5-484a-8ed0-0d36d12f4caa ((None, [{'url': 'file:///opt/stack/data/glance/images/d767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'metadata': {}}])) to volume db4a45b9-cabd-49f7-a1f4-a39b02ff08ac. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[84142e94-a1ad-443c-a4f6-36847cb2cfa3]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_6oqbs83j {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:16 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_6oqbs83j
Sep 29 18:31:16 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:16 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1782776306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d232991-050d-427e-8873-6a79073ee9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7606ca741e4e54aeaef193c3e6bc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:14Z,use_quota=True,user_id='b28bae13ad984d13bf0e7ae176776200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Creating volume 9d232991-050d-427e-8873-6a79073ee9e3 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:31:16 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:16 devstack sudo[105168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3 1073741824
Sep 29 18:31:16 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:16 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b" returned: 0 in 0.518s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_18400ae4-db9b-4240-a33e-fd7d9072d65c_f0qsf41jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:31:16 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:16 devstack sudo[105172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b 1G
Sep 29 18:31:16 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:16 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_6oqbs83j" returned: 0 in 0.379s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_6oqbs83j {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:16 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_6oqbs83j
Sep 29 18:31:16 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:16 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3 1073741824" returned: 0 in 0.431s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:16 devstack sudo[105184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3
Sep 29 18:31:16 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:16 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b 1G" returned: 0 in 0.363s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Downloaded image 18400ae4-db9b-4240-a33e-fd7d9072d65c ((None, [{'url': 'file:///opt/stack/data/glance/images/18400ae4-db9b-4240-a33e-fd7d9072d65c', 'metadata': {}}])) to volume df5a673e-ebf7-4c63-bf96-20528cbbf41b successfully. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Temporary image 18400ae4-db9b-4240-a33e-fd7d9072d65c for user 5d7197b3ec7643d0bb223c4fed87c8c8 is deleted. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Marking volume df5a673e-ebf7-4c63-bf96-20528cbbf41b as bootable. {{(pid=86821) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Copying metadata from image 18400ae4-db9b-4240-a33e-fd7d9072d65c to df5a673e-ebf7-4c63-bf96-20528cbbf41b. {{(pid=86821) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Creating volume glance metadata for volume df5a673e-ebf7-4c63-bf96-20528cbbf41b backed by image 18400ae4-db9b-4240-a33e-fd7d9072d65c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '18400ae4-db9b-4240-a33e-fd7d9072d65c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '42a3a5f73019e2c3bf4b2670d2ad51da', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86821) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 18:31:16 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_6oqbs83j" returned: 1 in 0.380s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_6oqbs83j' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd05602-133e-478d-bb43-3ebd97f786c2]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:16 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8800d2a-509a-439e-b60b-f7d124e287ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b', 'volume_size': 1, 'image_id': '18400ae4-db9b-4240-a33e-fd7d9072d65c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18400ae4-db9b-4240-a33e-fd7d9072d65c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42a3a5f73019e2c3bf4b2670d2ad51da', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '99d485a2bd874925a0d59290df757c18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23567456e71b037d33d6b6ff3e4933a354426ef0fb7f463c4e9121f3d13e7fed127e9190432f4af365a99de5f8d7712ceed5263206944e30232e02205783d640', 'id': '18400ae4-db9b-4240-a33e-fd7d9072d65c', 'created_at': datetime.datetime(2026, 9, 29, 16, 31, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 31, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18400ae4-db9b-4240-a33e-fd7d9072d65c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c482990>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5ea9a1-455d-4456-8f97-10b57846029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:17 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Volume volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b (df5a673e-ebf7-4c63-bf96-20528cbbf41b): created successfully
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5ea9a1-455d-4456-8f97-10b57846029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Flow 'volume_create_manager' (1e614901-1dcf-475b-84bb-701654d501e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:17 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fbc6e34e-73c3-4f0d-9980-ace1bfe1348b tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Created volume successfully.
Sep 29 18:31:17 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD
Sep 29 18:31:17 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:17 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Attempting download of d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb ((None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}])) to volume 9d232991-050d-427e-8873-6a79073ee9e3. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[887fb2cb-0148-4569-8aff-ad0a6bc8ec3f]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_l0_bdj9o {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:17 devstack sudo[105191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_l0_bdj9o
Sep 29 18:31:17 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:17 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:17 devstack sudo[105195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD
Sep 29 18:31:17 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:17 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_l0_bdj9o" returned: 0 in 0.342s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_l0_bdj9o {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:17 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_l0_bdj9o
Sep 29 18:31:17 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:17 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] d767a1cc-79b5-484a-8ed0-0d36d12f4caa was raw, converting to qcow2 {{(pid=86821) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:17 devstack sudo[105204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac
Sep 29 18:31:17 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:17 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_l0_bdj9o" returned: 1 in 0.308s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_l0_bdj9o' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baefbf2-41d0-4049-ab13-1791a5f021c4]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:17 devstack sudo[105208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD
Sep 29 18:31:17 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:18 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac" returned: 0 in 0.467s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d767a1cc-79b5-484a-8ed0-0d36d12f4caa_bm9weajrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:31:18 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:18 devstack sudo[105213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac 1G
Sep 29 18:31:18 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:18 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb was qcow2, converting to qcow2 {{(pid=86821) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Acquiring lock "cinder-df5a673e-ebf7-4c63-bf96-20528cbbf41b-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:18 devstack sudo[105218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3
Sep 29 18:31:18 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Lock "cinder-df5a673e-ebf7-4c63-bf96-20528cbbf41b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=167,cinder:UPDATE=206,cinder:INSERT=60,cinder:DELETE=13 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=167,cinder:UPDATE=207,cinder:DELETE=21,cinder:INSERT=50 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Acquiring lock "cinder-quobyte-df5a673e-ebf7-4c63-bf96-20528cbbf41b" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Lock "cinder-quobyte-df5a673e-ebf7-4c63-bf96-20528cbbf41b" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[587cfe3e-ed02-4fee-b623-44d52c2c87da]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:18 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac 1G" returned: 0 in 0.397s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Downloaded image d767a1cc-79b5-484a-8ed0-0d36d12f4caa ((None, [{'url': 'file:///opt/stack/data/glance/images/d767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'metadata': {}}])) to volume db4a45b9-cabd-49f7-a1f4-a39b02ff08ac successfully. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Temporary image d767a1cc-79b5-484a-8ed0-0d36d12f4caa for user d145769d20c24f57b5fcff6cb526092e is deleted. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Marking volume db4a45b9-cabd-49f7-a1f4-a39b02ff08ac as bootable. {{(pid=86821) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 18:31:18 devstack sudo[105220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b
Sep 29 18:31:18 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Copying metadata from image d767a1cc-79b5-484a-8ed0-0d36d12f4caa to db4a45b9-cabd-49f7-a1f4-a39b02ff08ac. {{(pid=86821) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Creating volume glance metadata for volume db4a45b9-cabd-49f7-a1f4-a39b02ff08ac backed by image d767a1cc-79b5-484a-8ed0-0d36d12f4caa with: {'image_id': 'd767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6357277b823a5c8a7f2c27ae84070c03', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86821) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6230e2-1558-4ad6-9fd5-553e6882e4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac', 'volume_size': 1, 'image_id': 'd767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6357277b823a5c8a7f2c27ae84070c03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'afd80bb639314ef2906316d2bc0d8456', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '519628607f80402a33c07d893873c6defdc3f3ad30d2a12bfb118e0e10cf6c9377065e4e0d9e589b4ba160d599cbb70cddbb48f65634c0649792cf62c8047530', 'id': 'd767a1cc-79b5-484a-8ed0-0d36d12f4caa', 'created_at': datetime.datetime(2026, 9, 29, 16, 31, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 31, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d767a1cc-79b5-484a-8ed0-0d36d12f4caa/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c325760>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab23202-8408-46c3-9f82-8067d1ead22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:18 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Volume volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac (db4a45b9-cabd-49f7-a1f4-a39b02ff08ac): created successfully
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab23202-8408-46c3-9f82-8067d1ead22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Flow 'volume_create_manager' (7051d1aa-ca83-4c5c-bbac-df715946aa80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:18 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c9c5566d-db6c-47a1-89c8-ff24e07ec43b tempest-VolumeImageDependencyTests-155010713 None] Created volume successfully.
Sep 29 18:31:18 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b" returned: 0 in 0.486s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:18 devstack sudo[105242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b
Sep 29 18:31:18 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:19 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df5a673e-ebf7-4c63-bf96-20528cbbf41b" returned: 0 in 0.277s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Lock "cinder-quobyte-df5a673e-ebf7-4c63-bf96-20528cbbf41b" released by "delete_volume" :: held 0.818s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:19 devstack cinder-volume[86821]: WARNING cinder.quota [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:31:19 devstack cinder-volume[86821]: WARNING cinder.quota [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Created reservations ['3d606c1d-fdf5-4442-80a1-8ae9dbed6046', 'f6f1ce9e-2ebd-403e-a493-2b479691790b', 'd2c334a5-54a0-40af-b800-688363ffbef1', '4a7b25c1-531c-490b-9285-ad7548fffc0d'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:19 devstack sudo[105245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:19 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Acquiring lock "cinder-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Lock "cinder-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Acquiring lock "cinder-quobyte-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Lock "cinder-quobyte-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbe73c9-d1fd-4f0b-8c21-822e499cf6d2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:19 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.381s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:19 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Deleted volume successfully.
Sep 29 18:31:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f3f51bf6-cb74-416f-a8c0-86264f882149 tempest-VolumeAndVolumeTypeFromImageTest-1075138764 None] Lock "cinder-df5a673e-ebf7-4c63-bf96-20528cbbf41b-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:19 devstack sudo[105248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac
Sep 29 18:31:19 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:20 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac" returned: 0 in 0.478s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:20 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac
Sep 29 18:31:20 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:20 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac" returned: 0 in 0.314s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Lock "cinder-quobyte-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac" released by "delete_volume" :: held 0.862s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Created reservations ['6104faa4-a4db-49c5-8bb8-16c8ddf2bb8d', 'b75fd512-4d5f-4179-9bca-12e7952642aa', '32550585-0fa1-4213-ac1d-d01ae1f5b31f', 'bd40185f-6195-4aee-acc8-641fba97590b'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:20 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3" returned: 0 in 2.378s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb_u2vko5a7devstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3 {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:31:20 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Converted 112.00 MB image at 47.07 MB/s
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:20 devstack sudo[105256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3 1G
Sep 29 18:31:20 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:20 devstack sudo[105258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:20 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:21 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.370s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:21 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Deleted volume successfully.
Sep 29 18:31:21 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78a5490d-5cd3-4f65-9e4e-a90261a1d9b6 tempest-VolumeImageDependencyTests-155010713 None] Lock "cinder-db4a45b9-cabd-49f7-a1f4-a39b02ff08ac-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3 1G" returned: 0 in 0.476s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Downloaded image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb ((None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}])) to volume 9d232991-050d-427e-8873-6a79073ee9e3 successfully. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Temporary image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb for user b28bae13ad984d13bf0e7ae176776200 is deleted. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Marking volume 9d232991-050d-427e-8873-6a79073ee9e3 as bootable. {{(pid=86821) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Copying metadata from image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb to 9d232991-050d-427e-8873-6a79073ee9e3. {{(pid=86821) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Creating volume glance metadata for volume 9d232991-050d-427e-8873-6a79073ee9e3 backed by image d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86821) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecc50b7-e807-4e6a-a9a4-a3f008b49918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d232991-050d-427e-8873-6a79073ee9e3', 'volume_size': 1, 'image_id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db58a07a5c7644049f96c8ee15f6a0db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd6d6c2e0-a1e8-4404-ac8f-1575e64f19bb', 'created_at': datetime.datetime(2026, 9, 29, 16, 9, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6d6c2e0-a1e8-4404-ac8f-1575e64f19bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b968dd760>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3455e9f-946a-40ce-a41e-801aeb97e52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:21 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Volume volume-9d232991-050d-427e-8873-6a79073ee9e3 (9d232991-050d-427e-8873-6a79073ee9e3): created successfully
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3455e9f-946a-40ce-a41e-801aeb97e52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Flow 'volume_create_manager' (62def1cc-d89f-480e-b455-5270b3c4f0ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:21 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5e27e886-962c-4132-a23d-bf03931e8282 tempest-TestShelveInstance-108306881 None] Created volume successfully.
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Flow 'volume_create_manager' (5f0d7680-3dd2-4d34-a433-00b4b1fe97c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad84748-82d1-4f53-917e-252d1135926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad84748-82d1-4f53-917e-252d1135926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-94697910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb5a794-f0a6-4245-b830-ffbd1cefea3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a5cae54a3045d88d13a14039c152ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:25Z,use_quota=True,user_id='fa46af5269954a578f566bd5620fde74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8248e09-47b4-4c5d-b9cd-9f404e8fb9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8248e09-47b4-4c5d-b9cd-9f404e8fb9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b491bbed-f77e-485f-9653-fdbcd8b6463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b491bbed-f77e-485f-9653-fdbcd8b6463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cb5a794-f0a6-4245-b830-ffbd1cefea3f', 'volume_name': 'volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b851aa9d-0a7f-4ffa-a1d2-b692a41f3742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b851aa9d-0a7f-4ffa-a1d2-b692a41f3742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c026cb1c-65f5-405e-b92f-94d77e132799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:25 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Volume 1cb5a794-f0a6-4245-b830-ffbd1cefea3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f', 'volume_size': 1}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-94697910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb5a794-f0a6-4245-b830-ffbd1cefea3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a5cae54a3045d88d13a14039c152ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:25Z,use_quota=True,user_id='fa46af5269954a578f566bd5620fde74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Creating volume 1cb5a794-f0a6-4245-b830-ffbd1cefea3f {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:31:25 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:25 devstack sudo[105268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f 1073741824
Sep 29 18:31:25 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-240bf850-4201-457c-8dd6-8de01e0d640d req-d09e5e27-c7b7-40ca-b399-7cf105281de8 tempest-TestShelveInstance-108306881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:25 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f 1073741824" returned: 0 in 0.691s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:25 devstack sudo[105282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f
Sep 29 18:31:25 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:26 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" returned: 0 in 0.306s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:31:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-240bf850-4201-457c-8dd6-8de01e0d640d req-d09e5e27-c7b7-40ca-b399-7cf105281de8 tempest-TestShelveInstance-108306881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.513s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-240bf850-4201-457c-8dd6-8de01e0d640d req-d09e5e27-c7b7-40ca-b399-7cf105281de8 tempest-TestShelveInstance-108306881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c026cb1c-65f5-405e-b92f-94d77e132799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa4e82e-2c45-41e3-bb08-7d78edaceec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Volume volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f (1cb5a794-f0a6-4245-b830-ffbd1cefea3f): created successfully
Sep 29 18:31:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa4e82e-2c45-41e3-bb08-7d78edaceec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Flow 'volume_create_manager' (5f0d7680-3dd2-4d34-a433-00b4b1fe97c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-eba5bb7e-c7a9-4fa1-8806-68d78017c2f1 tempest-VolumeDependencyTests-309036345 None] Created volume successfully.
Sep 29 18:31:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-240bf850-4201-457c-8dd6-8de01e0d640d req-d09e5e27-c7b7-40ca-b399-7cf105281de8 tempest-TestShelveInstance-108306881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-9d232991-050d-427e-8873-6a79073ee9e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb24e69f-c627-40b4-9e31-09d5c5b0339b', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:31:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-240bf850-4201-457c-8dd6-8de01e0d640d req-d09e5e27-c7b7-40ca-b399-7cf105281de8 tempest-TestShelveInstance-108306881 None] attachment_update completed successfully.
Sep 29 18:31:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] Creating offline snapshot 47f96268-5908-4c23-9577-3f7e53da4971 of volume 1cb5a794-f0a6-4245-b830-ffbd1cefea3f {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:31:27 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[40100655-d9c4-4c64-983c-5a4414ef16d0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:27 devstack sudo[105285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f
Sep 29 18:31:27 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:27 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" returned: 0 in 0.397s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:27 devstack sudo[105290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971 1G
Sep 29 18:31:27 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:28 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971 1G" returned: 0 in 0.670s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:28 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971
Sep 29 18:31:28 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:28 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971" returned: 0 in 0.364s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:28 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971 is being set with open permissions: ugo+rw
Sep 29 18:31:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:28 devstack sudo[105337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971
Sep 29 18:31:28 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:29 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971" returned: 0 in 0.364s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:29 devstack sudo[105440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.info
Sep 29 18:31:29 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:29 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.info" returned: 0 in 0.551s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:29 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.info is being set with open permissions: ugo+rw
Sep 29 18:31:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:29 devstack sudo[105784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.info
Sep 29 18:31:29 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:30 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.info" returned: 0 in 0.385s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.885s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-90b0cfd3-6113-4f47-b12a-82b9789acbfc tempest-VolumeDependencyTests-309036345 None] Create snapshot completed successfully
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Flow 'volume_create_manager' (fcb62113-1043-48fa-94c6-76a9189ce120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e91f953-8137-4159-8aa4-db4160cce040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e91f953-8137-4159-8aa4-db4160cce040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-258486253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63f265d-8f63-4d41-ba21-39ab72c49d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a5cae54a3045d88d13a14039c152ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=47f96268-5908-4c23-9577-3f7e53da4971,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:31Z,use_quota=True,user_id='fa46af5269954a578f566bd5620fde74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2e6d1d-57b8-4588-b0ee-8b2bf78cf9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2e6d1d-57b8-4588-b0ee-8b2bf78cf9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8b115b-1a71-4702-9ccf-b0eee8156193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8b115b-1a71-4702-9ccf-b0eee8156193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b63f265d-8f63-4d41-ba21-39ab72c49d0d', 'volume_name': 'volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d', 'volume_size': 1, 'snapshot_id': '47f96268-5908-4c23-9577-3f7e53da4971'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46087f20-cc7b-4369-9411-b5c1c935e45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46087f20-cc7b-4369-9411-b5c1c935e45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90164dc3-0868-46ec-afa2-1e793f58bc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:31 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Volume b63f265d-8f63-4d41-ba21-39ab72c49d0d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d', 'volume_size': 1, 'snapshot_id': '47f96268-5908-4c23-9577-3f7e53da4971'}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "cinder-quobyte-47f96268-5908-4c23-9577-3f7e53da4971-b63f265d-8f63-4d41-ba21-39ab72c49d0d" by "_create_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-47f96268-5908-4c23-9577-3f7e53da4971-b63f265d-8f63-4d41-ba21-39ab72c49d0d" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Creating volume b63f265d-8f63-4d41-ba21-39ab72c49d0d from snapshot 47f96268-5908-4c23-9577-3f7e53da4971 {{(pid=86821) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "cinder-quobyte-b63f265d-8f63-4d41-ba21-39ab72c49d0d" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-b63f265d-8f63-4d41-ba21-39ab72c49d0d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] snapshot: 47f96268-5908-4c23-9577-3f7e53da4971, volume: b63f265d-8f63-4d41-ba21-39ab72c49d0d,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7c9e75-85ca-4ada-80d4-3b0048cffd77]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:31 devstack sudo[105844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971
Sep 29 18:31:31 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:31 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971" returned: 0 in 0.398s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fdbd4c-743b-403e-85a0-73379255ab4f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:32 devstack sudo[105850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f
Sep 29 18:31:32 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Flow 'volume_create_manager' (19e75035-035e-487e-9aac-e83859c689ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e705e6d-763a-42cb-b3b0-89a58aafb403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e705e6d-763a-42cb-b3b0-89a58aafb403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736260742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a5f56f-4bce-4e4f-b477-dc89dcbc05b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf904505b29f430799b05b75c1b91ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:32Z,use_quota=True,user_id='470e9d9ad45f4ac1901ec15489a0de4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b36f1bb-d870-481f-b153-aa9702905c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b36f1bb-d870-481f-b153-aa9702905c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:32 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc33e4b-fa04-46ee-9948-88e9093374bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc33e4b-fa04-46ee-9948-88e9093374bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a5f56f-4bce-4e4f-b477-dc89dcbc05b2', 'volume_name': 'volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1737a4df-20a5-4241-8c24-85fbccf1824d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1737a4df-20a5-4241-8c24-85fbccf1824d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd55d98-c56e-4779-a766-08c05bad7e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:32 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Volume 05a5f56f-4bce-4e4f-b477-dc89dcbc05b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2', 'volume_size': 1}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" returned: 0 in 0.477s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:31:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:32 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d
Sep 29 18:31:32 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:41 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d" returned: 0 in 9.388s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:41 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f, size 1024.00 MB, duration 9.39 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:31:41 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Converted 1024.00 MB image at 109.06 MB/s
Sep 29 18:31:41 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d is being set with open permissions: ugo+rw
Sep 29 18:31:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:41 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d
Sep 29 18:31:41 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:42 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d" returned: 0 in 0.262s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-b63f265d-8f63-4d41-ba21-39ab72c49d0d" released by "_copy_volume_from_snapshot" :: held 10.645s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-47f96268-5908-4c23-9577-3f7e53da4971-b63f265d-8f63-4d41-ba21-39ab72c49d0d" released by "_create_volume_from_snapshot" :: held 10.719s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.743s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.736s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736260742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a5f56f-4bce-4e4f-b477-dc89dcbc05b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf904505b29f430799b05b75c1b91ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:32Z,use_quota=True,user_id='470e9d9ad45f4ac1901ec15489a0de4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Creating volume 05a5f56f-4bce-4e4f-b477-dc89dcbc05b2 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:31:42 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:42 devstack sudo[105877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2 1073741824
Sep 29 18:31:42 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90164dc3-0868-46ec-afa2-1e793f58bc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d', 'volume_size': 1, 'snapshot_id': '47f96268-5908-4c23-9577-3f7e53da4971'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e6b21e-a7ad-4d54-a3d4-6f7f2395bb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:42 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Volume volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d (b63f265d-8f63-4d41-ba21-39ab72c49d0d): created successfully
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e6b21e-a7ad-4d54-a3d4-6f7f2395bb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Flow 'volume_create_manager' (fcb62113-1043-48fa-94c6-76a9189ce120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0d43dafe-3c91-48b0-ade7-0b304cb9e7d7 tempest-VolumeDependencyTests-309036345 None] Created volume successfully.
Sep 29 18:31:42 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2 1073741824" returned: 0 in 0.471s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:42 devstack sudo[105882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2
Sep 29 18:31:42 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "cinder-47f96268-5908-4c23-9577-3f7e53da4971-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-47f96268-5908-4c23-9577-3f7e53da4971-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "cinder-quobyte-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "cinder-quobyte-47f96268-5908-4c23-9577-3f7e53da4971" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-47f96268-5908-4c23-9577-3f7e53da4971" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Deleting offline snapshot 47f96268-5908-4c23-9577-3f7e53da4971 of volume 1cb5a794-f0a6-4245-b830-ffbd1cefea3f {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] snapshot_file for this snap is: volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c3ff1a-3221-4eda-8c62-01a6a3596423]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:42 devstack sudo[105884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971
Sep 29 18:31:42 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:42 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2" returned: 0 in 0.301s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd55d98-c56e-4779-a766-08c05bad7e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbf5803-a83e-4860-8f97-6d63d82e9c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:43 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Volume volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2 (05a5f56f-4bce-4e4f-b477-dc89dcbc05b2): created successfully
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbf5803-a83e-4860-8f97-6d63d82e9c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Flow 'volume_create_manager' (19e75035-035e-487e-9aac-e83859c689ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:43 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f95190a7-c26b-49d6-9f2b-dcc2e9923f92 tempest-ProjectReaderTests-595925812 None] Created volume successfully.
Sep 29 18:31:43 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971" returned: 0 in 0.382s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f8c1fa-f77f-4122-92c0-8cc29b315177]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:43 devstack sudo[105891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f
Sep 29 18:31:43 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:43 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" returned: 0 in 0.538s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:43 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971
Sep 29 18:31:43 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Acquiring lock "cinder-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Lock "cinder-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Acquiring lock "cinder-quobyte-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Lock "cinder-quobyte-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f27f8b-fbfa-420a-aeb8-902f7a93b515]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:44 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971" returned: 0 in 0.386s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:44 devstack sudo[105902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2
Sep 29 18:31:44 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:44 devstack sudo[105903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971
Sep 29 18:31:44 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:44 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2" returned: 0 in 0.380s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:44 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f.47f96268-5908-4c23-9577-3f7e53da4971" returned: 0 in 0.296s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:44 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2
Sep 29 18:31:44 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-47f96268-5908-4c23-9577-3f7e53da4971" released by "_delete_snapshot" :: held 1.723s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" released by "delete_snapshot" :: held 1.749s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Created reservations ['8e30da2e-e7d8-4a98-996f-e6f70d0c7aa0', 'edbf1f79-cb1b-40ce-aff2-c1cfacd207c6', '5a755ae8-644d-411c-a8af-428bcf7e1659', '9b11d113-e2b5-4301-906d-b221c30bb427'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:44 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Delete snapshot completed successfully.
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5db905eb-0b0e-4718-8008-7f2ccc14aff4 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-47f96268-5908-4c23-9577-3f7e53da4971-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:44 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2" returned: 0 in 0.303s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Lock "cinder-quobyte-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2" released by "delete_volume" :: held 0.728s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Created reservations ['cb828bef-2069-48e4-87e0-c17960c63cff', '3585b9f4-fc62-4c30-bcc7-1520727bb004', 'a03e7dce-4047-445f-bdba-39c82781dea4', 'baaa268e-c1cc-4de7-b9b0-d132e6bbbd31'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Acquiring lock "cinder-1cb5a794-f0a6-4245-b830-ffbd1cefea3f-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Lock "cinder-1cb5a794-f0a6-4245-b830-ffbd1cefea3f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Acquiring lock "cinder-quobyte-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:44 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:44 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[414c618d-b232-4210-8879-63d9c0cd978f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:45 devstack sudo[105915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f
Sep 29 18:31:45 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:45 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.364s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Deleted volume successfully.
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-4cf19962-d695-4b2d-a578-c300bb9102da tempest-ProjectReaderTests-595925812 None] Lock "cinder-05a5f56f-4bce-4e4f-b477-dc89dcbc05b2-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:45 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" returned: 0 in 0.457s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:45 devstack sudo[105921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f
Sep 29 18:31:45 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Flow 'volume_create_manager' (e5979266-2ea3-4daf-a3af-7727d1033a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebccab4-684b-4e6e-a370-c4610b23fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebccab4-684b-4e6e-a370-c4610b23fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-464413581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada1db2d-e338-49f3-9818-4c60a8478a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf904505b29f430799b05b75c1b91ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:46Z,use_quota=True,user_id='470e9d9ad45f4ac1901ec15489a0de4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a57d33-2439-42e1-b8d3-a25dbb5a0bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a57d33-2439-42e1-b8d3-a25dbb5a0bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c87242-e97d-4535-abe8-383863e4cbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c87242-e97d-4535-abe8-383863e4cbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada1db2d-e338-49f3-9818-4c60a8478a01', 'volume_name': 'volume-ada1db2d-e338-49f3-9818-4c60a8478a01', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ca1669-4d8c-4929-8497-c90431cb9fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ca1669-4d8c-4929-8497-c90431cb9fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d265d34-53a5-49b0-b5b7-673c34ac8ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:45 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Volume ada1db2d-e338-49f3-9818-4c60a8478a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada1db2d-e338-49f3-9818-4c60a8478a01', 'volume_size': 1}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-464413581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada1db2d-e338-49f3-9818-4c60a8478a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf904505b29f430799b05b75c1b91ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:46Z,use_quota=True,user_id='470e9d9ad45f4ac1901ec15489a0de4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Creating volume ada1db2d-e338-49f3-9818-4c60a8478a01 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:31:45 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:45 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" returned: 0 in 0.283s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:45 devstack sudo[105924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01 1073741824
Sep 29 18:31:45 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-1cb5a794-f0a6-4245-b830-ffbd1cefea3f" released by "delete_volume" :: held 0.837s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Created reservations ['49b99a2c-dd1e-4a01-a143-e33b41773c94', '73ccd14c-edb5-49b3-b691-8f8e5dea54a1', 'ffa43556-052a-4435-8e72-466c4637032c', 'f1f4dd98-c5cc-4fd6-8455-ed2a8f5c4d09'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:46 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:46 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "cinder-b63f265d-8f63-4d41-ba21-39ab72c49d0d-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-b63f265d-8f63-4d41-ba21-39ab72c49d0d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "cinder-quobyte-b63f265d-8f63-4d41-ba21-39ab72c49d0d" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-b63f265d-8f63-4d41-ba21-39ab72c49d0d" acquired by "delete_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[030b75e6-0228-485a-8c75-67a9ef3381f5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:46 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.367s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Deleted volume successfully.
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-141643bf-78a8-4f3c-b867-ff3d568d44eb tempest-VolumeDependencyTests-309036345 None] Lock "cinder-1cb5a794-f0a6-4245-b830-ffbd1cefea3f-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:46 devstack sudo[105931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d
Sep 29 18:31:46 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:46 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01 1073741824" returned: 0 in 0.640s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:46 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01
Sep 29 18:31:46 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:46 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d" returned: 0 in 0.433s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:46 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d
Sep 29 18:31:46 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:46 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01" returned: 0 in 0.325s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d265d34-53a5-49b0-b5b7-673c34ac8ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada1db2d-e338-49f3-9818-4c60a8478a01', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b60ba56-6519-45c7-a58b-ccb53fb39d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:46 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Volume volume-ada1db2d-e338-49f3-9818-4c60a8478a01 (ada1db2d-e338-49f3-9818-4c60a8478a01): created successfully
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b60ba56-6519-45c7-a58b-ccb53fb39d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Flow 'volume_create_manager' (e5979266-2ea3-4daf-a3af-7727d1033a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ed5d8fdb-46f8-41f0-bf95-acc39d04ca79 tempest-ProjectReaderTests-595925812 None] Created volume successfully.
Sep 29 18:31:46 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b63f265d-8f63-4d41-ba21-39ab72c49d0d" returned: 0 in 0.258s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-quobyte-b63f265d-8f63-4d41-ba21-39ab72c49d0d" released by "delete_volume" :: held 0.748s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Created reservations ['44b0d8e4-e01e-4dab-a748-666912cd3f9a', 'bfbc1788-8ef0-4fe6-a6f4-4f4c4356595c', '4de9ad41-999b-47df-a898-d1519ff6edae', '503f654c-33e3-476a-ae8e-367545a0393c'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:47 devstack sudo[105943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:47 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:47 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.260s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:47 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Deleted volume successfully.
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-942c195d-70ab-4a46-bb07-cafda72469e4 tempest-VolumeDependencyTests-309036345 None] Lock "cinder-b63f265d-8f63-4d41-ba21-39ab72c49d0d-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Acquiring lock "cinder-ada1db2d-e338-49f3-9818-4c60a8478a01-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Lock "cinder-ada1db2d-e338-49f3-9818-4c60a8478a01-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Acquiring lock "cinder-quobyte-ada1db2d-e338-49f3-9818-4c60a8478a01" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Lock "cinder-quobyte-ada1db2d-e338-49f3-9818-4c60a8478a01" acquired by "delete_volume" :: waited 0.014s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e5a85c-e19e-417c-a31c-454cc3cff092]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:48 devstack sudo[105946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01
Sep 29 18:31:48 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:48 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01" returned: 0 in 0.435s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:48 devstack sudo[105951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01
Sep 29 18:31:48 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:48 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ada1db2d-e338-49f3-9818-4c60a8478a01" returned: 0 in 0.313s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Lock "cinder-quobyte-ada1db2d-e338-49f3-9818-4c60a8478a01" released by "delete_volume" :: held 0.801s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:48 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Created reservations ['29398c72-b87d-4566-876c-d57754feee2b', '3c2a6730-ba3b-4576-9226-741ef86186c8', '6a5e248b-d1f7-4e21-b630-3d4b4a0a7c2f', '25c1d18e-f03a-40d6-b36f-0fa608fdc802'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:48 devstack sudo[105955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:48 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:49 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.383s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:49 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Deleted volume successfully.
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bac8064b-1c6f-4efa-b6d8-99ee6a4aa2f9 tempest-ProjectReaderTests-595925812 None] Lock "cinder-ada1db2d-e338-49f3-9818-4c60a8478a01-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Flow 'volume_create_manager' (84c1a2c9-00b7-448e-84a3-5f59874c457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8fd3fc-f0ac-4351-a428-3894e36bbe89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8fd3fc-f0ac-4351-a428-3894e36bbe89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-407220627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f669d3-50c1-4ec9-a2b5-00806cc72fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf904505b29f430799b05b75c1b91ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:50Z,use_quota=True,user_id='470e9d9ad45f4ac1901ec15489a0de4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70202b1-b1c3-486d-b7df-ea89fc3ebed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70202b1-b1c3-486d-b7df-ea89fc3ebed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28bc8f06-4d00-44f5-ae68-d38ffe3ea74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28bc8f06-4d00-44f5-ae68-d38ffe3ea74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1f669d3-50c1-4ec9-a2b5-00806cc72fb0', 'volume_name': 'volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb2c17f-e358-4e4e-9645-d9ea03f1a450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb2c17f-e358-4e4e-9645-d9ea03f1a450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc82e949-6b6d-4243-bd4a-33dc597fa915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:49 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Volume d1f669d3-50c1-4ec9-a2b5-00806cc72fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0', 'volume_size': 1}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-407220627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f669d3-50c1-4ec9-a2b5-00806cc72fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf904505b29f430799b05b75c1b91ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:50Z,use_quota=True,user_id='470e9d9ad45f4ac1901ec15489a0de4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Creating volume d1f669d3-50c1-4ec9-a2b5-00806cc72fb0 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:31:49 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:31:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:49 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0 1073741824
Sep 29 18:31:49 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:50 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0 1073741824" returned: 0 in 0.623s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:50 devstack sudo[105994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0
Sep 29 18:31:50 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:50 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0" returned: 0 in 0.268s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:31:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc82e949-6b6d-4243-bd4a-33dc597fa915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149799f8-afe9-4aed-bfbb-f72841ba3138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:50 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Volume volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0 (d1f669d3-50c1-4ec9-a2b5-00806cc72fb0): created successfully
Sep 29 18:31:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149799f8-afe9-4aed-bfbb-f72841ba3138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Flow 'volume_create_manager' (84c1a2c9-00b7-448e-84a3-5f59874c457d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:50 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bdd9486f-e9c5-43b3-8453-1df7878ad6b5 tempest-ProjectReaderTests-595925812 None] Created volume successfully.
Sep 29 18:31:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Acquiring lock "cinder-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Lock "cinder-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Acquiring lock "cinder-quobyte-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Lock "cinder-quobyte-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0" acquired by "delete_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:51 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee52f544-b7e5-4e6c-8b01-169453ae8e42]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:52 devstack sudo[106007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0
Sep 29 18:31:52 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Flow 'volume_create_manager' (8792c259-2caa-4768-816d-851f053fa823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca51342a-b549-4700-a3c0-466936e02957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca51342a-b549-4700-a3c0-466936e02957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696813444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc589840-c881-454a-9605-4a9b5a368adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65c27271c7b4c1faf0cdde552c1f3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:52Z,use_quota=True,user_id='83fd1a66d8494474b6108208497befcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c49b05-b7ca-4ec7-9e5a-7b5207cf9214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c49b05-b7ca-4ec7-9e5a-7b5207cf9214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f96397-4901-4b1b-bcfc-e6ef2f5b5e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f96397-4901-4b1b-bcfc-e6ef2f5b5e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc589840-c881-454a-9605-4a9b5a368adb', 'volume_name': 'volume-bc589840-c881-454a-9605-4a9b5a368adb', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916a192d-e161-4c76-b438-bc4c03d52085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916a192d-e161-4c76-b438-bc4c03d52085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11aa019d-c7e7-45bf-a5ab-f8bc1727baae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:52 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Volume bc589840-c881-454a-9605-4a9b5a368adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc589840-c881-454a-9605-4a9b5a368adb', 'volume_size': 1}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696813444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc589840-c881-454a-9605-4a9b5a368adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65c27271c7b4c1faf0cdde552c1f3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:52Z,use_quota=True,user_id='83fd1a66d8494474b6108208497befcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Creating volume bc589840-c881-454a-9605-4a9b5a368adb {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:31:52 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:52 devstack sudo[106009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb 1073741824
Sep 29 18:31:52 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:52 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0" returned: 0 in 0.444s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:52 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0
Sep 29 18:31:52 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:52 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb 1073741824" returned: 0 in 0.447s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:52 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:52 devstack sudo[106020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb
Sep 29 18:31:52 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0" returned: 0 in 0.308s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Lock "cinder-quobyte-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0" released by "delete_volume" :: held 0.804s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Created reservations ['48b277ae-2149-4764-a3f7-519392b0f7d4', 'cb1e4648-9e87-4ec7-a112-017dc61f52d5', 'a4e325f1-ce6f-4902-8db7-8b207e9079f0', 'd4c971bd-ca93-4ffd-ab9f-a389654de144'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:52 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:52 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:52 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb" returned: 0 in 0.272s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11aa019d-c7e7-45bf-a5ab-f8bc1727baae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc589840-c881-454a-9605-4a9b5a368adb', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65151ade-1740-4634-bf44-9b4e7445a734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:52 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Volume volume-bc589840-c881-454a-9605-4a9b5a368adb (bc589840-c881-454a-9605-4a9b5a368adb): created successfully
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65151ade-1740-4634-bf44-9b4e7445a734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Flow 'volume_create_manager' (8792c259-2caa-4768-816d-851f053fa823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:52 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a445d283-55d4-417f-bb35-19f227679351 tempest-ProjectReaderTests-1348970896 None] Created volume successfully.
Sep 29 18:31:53 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.261s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:53 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Deleted volume successfully.
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-637db184-0f9e-44df-85a0-6992c71d4491 tempest-ProjectReaderTests-595925812 None] Lock "cinder-d1f669d3-50c1-4ec9-a2b5-00806cc72fb0-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Acquiring lock "cinder-bc589840-c881-454a-9605-4a9b5a368adb-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Lock "cinder-bc589840-c881-454a-9605-4a9b5a368adb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Acquiring lock "cinder-quobyte-bc589840-c881-454a-9605-4a9b5a368adb" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Lock "cinder-quobyte-bc589840-c881-454a-9605-4a9b5a368adb" acquired by "delete_volume" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[18343537-a264-4f85-9c5c-b8ea345ec220]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Flow 'volume_create_manager' (fccebd63-7a94-4862-b806-f3f4c860c284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:53 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb
Sep 29 18:31:53 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f547881b-25e4-4e52-8b57-440587c379fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f547881b-25e4-4e52-8b57-440587c379fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1406091467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8502058d-55ed-4113-9622-d7692010488d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf904505b29f430799b05b75c1b91ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:53Z,use_quota=True,user_id='470e9d9ad45f4ac1901ec15489a0de4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff7f72a-633c-4cc1-accb-b0f669a00f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff7f72a-633c-4cc1-accb-b0f669a00f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e2ab91-952d-4713-ba07-9478283f5c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e2ab91-952d-4713-ba07-9478283f5c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8502058d-55ed-4113-9622-d7692010488d', 'volume_name': 'volume-8502058d-55ed-4113-9622-d7692010488d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e06c452-fda9-4ebb-96a2-69d18d59775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e06c452-fda9-4ebb-96a2-69d18d59775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732cdc8a-75af-4cc6-9f0f-e9a95a4a74e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:53 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Volume 8502058d-55ed-4113-9622-d7692010488d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8502058d-55ed-4113-9622-d7692010488d', 'volume_size': 1}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1406091467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8502058d-55ed-4113-9622-d7692010488d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf904505b29f430799b05b75c1b91ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:53Z,use_quota=True,user_id='470e9d9ad45f4ac1901ec15489a0de4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Creating volume 8502058d-55ed-4113-9622-d7692010488d {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:31:53 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:53 devstack sudo[106029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d 1073741824
Sep 29 18:31:53 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:53 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb" returned: 0 in 0.376s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:53 devstack sudo[106034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb
Sep 29 18:31:53 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:54 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d 1073741824" returned: 0 in 0.437s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:54 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-bc589840-c881-454a-9605-4a9b5a368adb" returned: 0 in 0.273s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Lock "cinder-quobyte-bc589840-c881-454a-9605-4a9b5a368adb" released by "delete_volume" :: held 0.697s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:54 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d
Sep 29 18:31:54 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Created reservations ['e248cae6-b61e-4b3f-8e08-0720e3901f22', 'd3cdd170-0d0e-4d0c-861c-9684df402909', '0b521eb1-31a5-4bac-b019-c7564a5fdf59', 'f71874b2-7b8f-4cd9-bb55-f8dd07995679'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:54 devstack sudo[106042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:54 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:54 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d" returned: 0 in 0.296s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732cdc8a-75af-4cc6-9f0f-e9a95a4a74e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8502058d-55ed-4113-9622-d7692010488d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d3f376-b9a8-40cd-9998-37e547c3cefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:54 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Volume volume-8502058d-55ed-4113-9622-d7692010488d (8502058d-55ed-4113-9622-d7692010488d): created successfully
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d3f376-b9a8-40cd-9998-37e547c3cefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Flow 'volume_create_manager' (fccebd63-7a94-4862-b806-f3f4c860c284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-30890511-a0eb-48e1-8bad-b43faf965194 tempest-ProjectReaderTests-595925812 None] Created volume successfully.
Sep 29 18:31:54 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:54 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:54 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.300s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Deleted volume successfully.
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9e919ed9-122a-423b-9dba-6ab5e6a47208 tempest-ProjectReaderTests-1348970896 None] Lock "cinder-bc589840-c881-454a-9605-4a9b5a368adb-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:54 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.322s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Flow 'volume_create_manager' (12ed25bb-d89d-4e4b-9783-67877b5634fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddab842b-6a8e-47ae-8b66-d39aa51b2cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddab842b-6a8e-47ae-8b66-d39aa51b2cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1160351009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f73fc62-7a89-46ca-8b09-ab7dde33ad40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65c27271c7b4c1faf0cdde552c1f3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:55Z,use_quota=True,user_id='83fd1a66d8494474b6108208497befcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc43651-f1f4-47c5-9bb9-9a52228d81c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc43651-f1f4-47c5-9bb9-9a52228d81c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f48988-4ddf-45cd-9df3-540bdd4b502f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f48988-4ddf-45cd-9df3-540bdd4b502f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f73fc62-7a89-46ca-8b09-ab7dde33ad40', 'volume_name': 'volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08f4e56-9bac-4efb-b9ba-84d81397f54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08f4e56-9bac-4efb-b9ba-84d81397f54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50651e72-3587-4571-85c2-f71a55f1b997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:54 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Volume 9f73fc62-7a89-46ca-8b09-ab7dde33ad40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40', 'volume_size': 1}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1160351009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f73fc62-7a89-46ca-8b09-ab7dde33ad40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65c27271c7b4c1faf0cdde552c1f3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:55Z,use_quota=True,user_id='83fd1a66d8494474b6108208497befcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Creating volume 9f73fc62-7a89-46ca-8b09-ab7dde33ad40 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:31:54 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:31:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:55 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40 1073741824
Sep 29 18:31:55 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:55 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40 1073741824" returned: 0 in 0.384s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:55 devstack sudo[106054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40
Sep 29 18:31:55 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Acquiring lock "cinder-8502058d-55ed-4113-9622-d7692010488d-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Lock "cinder-8502058d-55ed-4113-9622-d7692010488d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Acquiring lock "cinder-quobyte-8502058d-55ed-4113-9622-d7692010488d" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:55 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40" returned: 0 in 0.258s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Lock "cinder-quobyte-8502058d-55ed-4113-9622-d7692010488d" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50651e72-3587-4571-85c2-f71a55f1b997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616ba7a5-9267-4b6c-9c23-97b7bfd7924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a267a1ca-3e17-42fa-8b53-f22660bb4a03]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:55 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Volume volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40 (9f73fc62-7a89-46ca-8b09-ab7dde33ad40): created successfully
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616ba7a5-9267-4b6c-9c23-97b7bfd7924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Flow 'volume_create_manager' (12ed25bb-d89d-4e4b-9783-67877b5634fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:31:55 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-14d0103a-6bf6-4db1-935b-600a12d6f796 tempest-ProjectReaderTests-1348970896 None] Created volume successfully.
Sep 29 18:31:55 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d
Sep 29 18:31:55 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Acquiring lock "cinder-9f73fc62-7a89-46ca-8b09-ab7dde33ad40-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Lock "cinder-9f73fc62-7a89-46ca-8b09-ab7dde33ad40-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Acquiring lock "cinder-quobyte-9f73fc62-7a89-46ca-8b09-ab7dde33ad40" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Lock "cinder-quobyte-9f73fc62-7a89-46ca-8b09-ab7dde33ad40" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3629797-0a62-4e20-a0c5-54fb0c24cc86]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:56 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d" returned: 0 in 0.379s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:56 devstack sudo[106063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d
Sep 29 18:31:56 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:56 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40
Sep 29 18:31:56 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:56 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8502058d-55ed-4113-9622-d7692010488d" returned: 0 in 0.267s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Lock "cinder-quobyte-8502058d-55ed-4113-9622-d7692010488d" released by "delete_volume" :: held 0.697s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Created reservations ['e23b535a-11b4-41ea-805d-f0c6bde7166b', '0128adf5-acb3-48af-9110-5a373f6db075', 'd1c95a14-84db-40bf-bbec-938869d2bb00', '5bb615a8-8dd2-466a-a69f-1679b28fb1d5'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:56 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40" returned: 0 in 0.403s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:56 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40
Sep 29 18:31:56 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:56 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:56 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:56 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9f73fc62-7a89-46ca-8b09-ab7dde33ad40" returned: 0 in 0.278s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Lock "cinder-quobyte-9f73fc62-7a89-46ca-8b09-ab7dde33ad40" released by "delete_volume" :: held 0.727s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:56 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.252s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:56 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Deleted volume successfully.
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a38dbc35-297a-4426-9da6-a8586db1a8ce tempest-ProjectReaderTests-595925812 None] Lock "cinder-8502058d-55ed-4113-9622-d7692010488d-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Created reservations ['322531cd-39a7-4d66-8e3f-8fe2ec930223', '7ab6f289-4d51-4f04-98ef-e92b6aad29af', 'ea325070-88cf-4542-b0c4-cfeb49c81751', '68f49792-bab6-4e8c-a172-35e48b43861f'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:31:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:31:56 devstack sudo[106076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:31:56 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:31:57 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root
Sep 29 18:31:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.254s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:31:57 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:31:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Deleted volume successfully.
Sep 29 18:31:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-81ab3dd6-66e3-48a3-8473-e51b3a140767 tempest-ProjectReaderTests-1348970896 None] Lock "cinder-9f73fc62-7a89-46ca-8b09-ab7dde33ad40-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:03 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-59a43044-3899-49f6-998a-50c7313ce75b req-454ce690-b6ca-439d-9a4a-c7e1bacf8084 tempest-TestShelveInstance-108306881 None] Terminate volume connection completed successfully.
Sep 29 18:32:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-59a43044-3899-49f6-998a-50c7313ce75b req-454ce690-b6ca-439d-9a4a-c7e1bacf8084 tempest-TestShelveInstance-108306881 None] Deleting attachment bb24e69f-c627-40b4-9e31-09d5c5b0339b. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:32:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-87034a6e-43b6-4a9f-a479-d1c9e9bbf175 req-e4a3b0d1-e3fd-4fed-a97e-7b15e2b68f92 tempest-TestShelveInstance-108306881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:32:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-87034a6e-43b6-4a9f-a479-d1c9e9bbf175 req-e4a3b0d1-e3fd-4fed-a97e-7b15e2b68f92 tempest-TestShelveInstance-108306881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:32:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-87034a6e-43b6-4a9f-a479-d1c9e9bbf175 req-e4a3b0d1-e3fd-4fed-a97e-7b15e2b68f92 tempest-TestShelveInstance-108306881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:32:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-87034a6e-43b6-4a9f-a479-d1c9e9bbf175 req-e4a3b0d1-e3fd-4fed-a97e-7b15e2b68f92 tempest-TestShelveInstance-108306881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87', 'name': 'volume-9d232991-050d-427e-8873-6a79073ee9e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0c232cb-6652-4b77-9ad5-bd78b692f182', 'enforce_multipath': True} {{(pid=86821) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 29 18:32:06 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-87034a6e-43b6-4a9f-a479-d1c9e9bbf175 req-e4a3b0d1-e3fd-4fed-a97e-7b15e2b68f92 tempest-TestShelveInstance-108306881 None] attachment_update completed successfully.
Sep 29 18:32:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=112,cinder:SELECT=103,cinder:INSERT=39,cinder:DELETE=16 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:32:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=100,cinder:INSERT=34,cinder:UPDATE=124,cinder:DELETE=5 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Flow 'volume_create_manager' (6b993de5-d97a-4b89-be2c-b10fb5622dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8765469d-b7b1-4c48-9995-ed54e2b48e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8765469d-b7b1-4c48-9995-ed54e2b48e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-118618491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12deaf45-f200-424a-a54e-f3ddc1ca4fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef29cf046ab84ea192e0321272cb23b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:32:26Z,use_quota=True,user_id='6fe2af03c1e94c2fb79ad038ab2ab325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecefd589-5b25-474d-a0a0-d5827c002b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecefd589-5b25-474d-a0a0-d5827c002b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae41dd77-fed3-4c46-8421-0f948424a392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae41dd77-fed3-4c46-8421-0f948424a392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12deaf45-f200-424a-a54e-f3ddc1ca4fff', 'volume_name': 'volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64d90bc-9853-4eae-89a4-6671fafb44a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64d90bc-9853-4eae-89a4-6671fafb44a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f6403e-c1d6-4d26-b190-b366dfb3e2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Volume 12deaf45-f200-424a-a54e-f3ddc1ca4fff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff', 'volume_size': 1}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-118618491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12deaf45-f200-424a-a54e-f3ddc1ca4fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef29cf046ab84ea192e0321272cb23b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:32:26Z,use_quota=True,user_id='6fe2af03c1e94c2fb79ad038ab2ab325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Creating volume 12deaf45-f200-424a-a54e-f3ddc1ca4fff {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:32:26 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:26 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff 1073741824
Sep 29 18:32:26 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:26 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff 1073741824" returned: 0 in 0.506s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:26 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff
Sep 29 18:32:26 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:26 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff" returned: 0 in 0.249s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f6403e-c1d6-4d26-b190-b366dfb3e2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8269b1f-7b70-449e-836f-1d1b6a9afa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Volume volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff (12deaf45-f200-424a-a54e-f3ddc1ca4fff): created successfully
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8269b1f-7b70-449e-836f-1d1b6a9afa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Flow 'volume_create_manager' (6b993de5-d97a-4b89-be2c-b10fb5622dbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:32:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1b9cd329-ecfb-47f9-a053-4645fa6fc74f tempest-SnapshotDependencyTests-948328823 None] Created volume successfully.
Sep 29 18:32:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:32:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:32:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] Creating offline snapshot d9ac0e05-f959-45be-b42d-d24fdc7c9a3e of volume 12deaf45-f200-424a-a54e-f3ddc1ca4fff {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:32:28 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6c9295-145d-4152-ae82-37f5ed774d7a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:32:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:28 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff
Sep 29 18:32:28 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:28 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff" returned: 0 in 0.362s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:28 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e 1G
Sep 29 18:32:28 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:29 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e 1G" returned: 0 in 0.403s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:29 devstack sudo[106696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e
Sep 29 18:32:29 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:29 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e" returned: 0 in 0.303s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:29 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e is being set with open permissions: ugo+rw
Sep 29 18:32:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:29 devstack sudo[106703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e
Sep 29 18:32:29 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:29 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e" returned: 0 in 0.235s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:29 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.info
Sep 29 18:32:29 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:29 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.info" returned: 0 in 0.244s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:29 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.info is being set with open permissions: ugo+rw
Sep 29 18:32:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:30 devstack sudo[106733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.info
Sep 29 18:32:30 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:30 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.info" returned: 0 in 0.244s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:32:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3d9b6330-26fe-4185-8b7d-6bf7cc8cf316 tempest-SnapshotDependencyTests-948328823 None] Create snapshot completed successfully
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Flow 'volume_create_manager' (e06a75c9-a804-4a17-ac9e-0dd128c92265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003fe8bd-cba2-418c-bc25-42dc22f1f34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003fe8bd-cba2-418c-bc25-42dc22f1f34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b36ee3-b96b-40f3-8b97-9cea118744de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef29cf046ab84ea192e0321272cb23b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9ac0e05-f959-45be-b42d-d24fdc7c9a3e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:32:31Z,use_quota=True,user_id='6fe2af03c1e94c2fb79ad038ab2ab325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2afce1-2fbf-47dd-849d-518e4c3822e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2afce1-2fbf-47dd-849d-518e4c3822e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea845f2-5919-4cbd-af72-3c16693d713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea845f2-5919-4cbd-af72-3c16693d713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '14b36ee3-b96b-40f3-8b97-9cea118744de', 'volume_name': 'volume-14b36ee3-b96b-40f3-8b97-9cea118744de', 'volume_size': 1, 'snapshot_id': 'd9ac0e05-f959-45be-b42d-d24fdc7c9a3e'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5408240-a1f7-4fa0-af2c-48e673af0561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5408240-a1f7-4fa0-af2c-48e673af0561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e2c83e-7d73-4567-9ee5-d8b809d8a38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:31 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Volume 14b36ee3-b96b-40f3-8b97-9cea118744de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-14b36ee3-b96b-40f3-8b97-9cea118744de', 'volume_size': 1, 'snapshot_id': 'd9ac0e05-f959-45be-b42d-d24fdc7c9a3e'}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "cinder-quobyte-d9ac0e05-f959-45be-b42d-d24fdc7c9a3e-14b36ee3-b96b-40f3-8b97-9cea118744de" by "_create_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-d9ac0e05-f959-45be-b42d-d24fdc7c9a3e-14b36ee3-b96b-40f3-8b97-9cea118744de" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Creating volume 14b36ee3-b96b-40f3-8b97-9cea118744de from snapshot d9ac0e05-f959-45be-b42d-d24fdc7c9a3e {{(pid=86821) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "cinder-quobyte-14b36ee3-b96b-40f3-8b97-9cea118744de" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-14b36ee3-b96b-40f3-8b97-9cea118744de" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] snapshot: d9ac0e05-f959-45be-b42d-d24fdc7c9a3e, volume: 14b36ee3-b96b-40f3-8b97-9cea118744de,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96afe7e-024e-46a8-8ed4-d73c26fbb864]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:31 devstack sudo[106742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e
Sep 29 18:32:31 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:31 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e" returned: 0 in 0.357s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d1c240-df0a-4ffe-857b-87d3ad0b47a8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:32:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:31 devstack sudo[106747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff
Sep 29 18:32:31 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:32 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff" returned: 0 in 0.404s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:32:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:32:32 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:32:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:32 devstack sudo[106753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de
Sep 29 18:32:32 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:38 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de" returned: 0 in 6.420s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:38 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:32:38 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Converted 1024.00 MB image at 159.48 MB/s
Sep 29 18:32:38 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de is being set with open permissions: ugo+rw
Sep 29 18:32:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:38 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de
Sep 29 18:32:38 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:38 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de" returned: 0 in 0.246s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-14b36ee3-b96b-40f3-8b97-9cea118744de" released by "_copy_volume_from_snapshot" :: held 7.509s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-d9ac0e05-f959-45be-b42d-d24fdc7c9a3e-14b36ee3-b96b-40f3-8b97-9cea118744de" released by "_create_volume_from_snapshot" :: held 7.569s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.583s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:32:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e2c83e-7d73-4567-9ee5-d8b809d8a38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b36ee3-b96b-40f3-8b97-9cea118744de', 'volume_size': 1, 'snapshot_id': 'd9ac0e05-f959-45be-b42d-d24fdc7c9a3e'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25151579-640f-48d1-a25c-6ffdd28ab038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:32:38 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Volume volume-14b36ee3-b96b-40f3-8b97-9cea118744de (14b36ee3-b96b-40f3-8b97-9cea118744de): created successfully
Sep 29 18:32:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25151579-640f-48d1-a25c-6ffdd28ab038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:32:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Flow 'volume_create_manager' (e06a75c9-a804-4a17-ac9e-0dd128c92265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:32:38 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5e10ed57-f59b-4a97-b95d-5cc92061d815 tempest-SnapshotDependencyTests-948328823 None] Created volume successfully.
Sep 29 18:32:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "cinder-d9ac0e05-f959-45be-b42d-d24fdc7c9a3e-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:32:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-d9ac0e05-f959-45be-b42d-d24fdc7c9a3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:32:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "cinder-quobyte-12deaf45-f200-424a-a54e-f3ddc1ca4fff" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:32:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-12deaf45-f200-424a-a54e-f3ddc1ca4fff" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:32:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "cinder-quobyte-d9ac0e05-f959-45be-b42d-d24fdc7c9a3e" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:32:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-d9ac0e05-f959-45be-b42d-d24fdc7c9a3e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:32:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Deleting offline snapshot d9ac0e05-f959-45be-b42d-d24fdc7c9a3e of volume 12deaf45-f200-424a-a54e-f3ddc1ca4fff {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:32:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] snapshot_file for this snap is: volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:32:39 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d3d65a-5811-4310-86c3-554043de03fe]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:32:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:39 devstack sudo[106770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e
Sep 29 18:32:39 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:40 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e" returned: 0 in 0.395s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:32:40 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5989453-a166-4803-89a8-e87e8da0c8b2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:32:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:40 devstack sudo[106775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff
Sep 29 18:32:40 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:40 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff" returned: 0 in 0.584s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:40 devstack sudo[106780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e
Sep 29 18:32:40 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:41 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e" returned: 0 in 0.342s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:41 devstack sudo[106785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e
Sep 29 18:32:41 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:41 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff.d9ac0e05-f959-45be-b42d-d24fdc7c9a3e" returned: 0 in 0.274s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-d9ac0e05-f959-45be-b42d-d24fdc7c9a3e" released by "_delete_snapshot" :: held 1.710s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-12deaf45-f200-424a-a54e-f3ddc1ca4fff" released by "delete_snapshot" :: held 1.733s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:41 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Created reservations ['4a114670-84af-41b8-8257-caa0e0dcc524', '96f969df-b81a-41c5-a4ba-3f7b081f2b2e', 'b5a2efa9-4d1b-47e3-bc04-9964526e8b65', 'ea57aef5-f961-46bc-af1b-b1ab66071055'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:32:41 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Delete snapshot completed successfully.
Sep 29 18:32:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38a82f0a-6555-46e9-a865-4afb1c7e0cd7 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-d9ac0e05-f959-45be-b42d-d24fdc7c9a3e-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "cinder-12deaf45-f200-424a-a54e-f3ddc1ca4fff-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:32:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-12deaf45-f200-424a-a54e-f3ddc1ca4fff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:32:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "cinder-quobyte-12deaf45-f200-424a-a54e-f3ddc1ca4fff" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-12deaf45-f200-424a-a54e-f3ddc1ca4fff" acquired by "delete_volume" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a906722e-e760-43fb-b774-0163a8ca7418]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:42 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff
Sep 29 18:32:42 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:42 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff" returned: 0 in 0.394s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:42 devstack sudo[106793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff
Sep 29 18:32:42 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:42 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-12deaf45-f200-424a-a54e-f3ddc1ca4fff" returned: 0 in 0.268s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-12deaf45-f200-424a-a54e-f3ddc1ca4fff" released by "delete_volume" :: held 0.749s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Created reservations ['160d6a7d-a649-4fcb-a612-82fa0f9450d9', 'da390fae-e1ee-414e-8444-3feec2ffa40a', 'ffe7e602-d78e-4492-a025-94ea9d720b80', '193c0d45-f387-4f1d-86fd-652bc5cc41ca'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:32:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:42 devstack sudo[106796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:32:42 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:43 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "cinder-14b36ee3-b96b-40f3-8b97-9cea118744de-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.255s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:32:43 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Deleted volume successfully.
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-14b36ee3-b96b-40f3-8b97-9cea118744de-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-aba8552d-9746-47ab-9843-304e2c61def3 tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-12deaf45-f200-424a-a54e-f3ddc1ca4fff-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "cinder-quobyte-14b36ee3-b96b-40f3-8b97-9cea118744de" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-14b36ee3-b96b-40f3-8b97-9cea118744de" acquired by "delete_volume" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7861d0-c9b9-4082-9ca8-6bc44aa09f8c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:43 devstack sudo[106800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de
Sep 29 18:32:43 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:43 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de" returned: 0 in 0.352s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:43 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de
Sep 29 18:32:43 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:43 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14b36ee3-b96b-40f3-8b97-9cea118744de" returned: 0 in 0.243s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-quobyte-14b36ee3-b96b-40f3-8b97-9cea118744de" released by "delete_volume" :: held 0.640s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Created reservations ['2bd08553-fd45-4230-808b-1bcad91fd94c', '214f7fd9-f88b-4198-a8ef-362da56e265c', '5904f90c-8041-4fab-b0ef-80deac270f58', 'dfa04c03-fbf5-4864-bfa6-19ff0e19417a'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:32:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:43 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:32:43 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:44 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.240s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:44 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:32:44 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Deleted volume successfully.
Sep 29 18:32:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-15a9cc4a-b02b-489b-9356-f7cdfc3b0b7c tempest-SnapshotDependencyTests-948328823 None] Lock "cinder-14b36ee3-b96b-40f3-8b97-9cea118744de-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:52 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-ceba3d21-1cc8-479c-87fe-05b5bbddbe4b tempest-TestShelveInstance-108306881 None] Terminate volume connection completed successfully.
Sep 29 18:32:52 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-ceba3d21-1cc8-479c-87fe-05b5bbddbe4b tempest-TestShelveInstance-108306881 None] Deleting attachment f0c232cb-6652-4b77-9ad5-bd78b692f182. {{(pid=86821) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 29 18:32:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Acquiring lock "cinder-9d232991-050d-427e-8873-6a79073ee9e3-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:32:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Lock "cinder-9d232991-050d-427e-8873-6a79073ee9e3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:32:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Acquiring lock "cinder-quobyte-9d232991-050d-427e-8873-6a79073ee9e3" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:32:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Lock "cinder-quobyte-9d232991-050d-427e-8873-6a79073ee9e3" acquired by "delete_volume" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:32:52 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8080fcc1-7936-492e-88fc-4d1c633409f7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:32:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:53 devstack sudo[106850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3
Sep 29 18:32:53 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:53 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3" returned: 0 in 0.460s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:53 devstack sudo[106856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3
Sep 29 18:32:53 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:53 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-9d232991-050d-427e-8873-6a79073ee9e3" returned: 0 in 0.258s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Lock "cinder-quobyte-9d232991-050d-427e-8873-6a79073ee9e3" released by "delete_volume" :: held 0.779s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:53 devstack cinder-volume[86821]: DEBUG cinder.quota [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Created reservations ['4cd1d5de-388c-43f9-bd10-513cc7483453', 'e130f346-adfd-4740-98d6-73585932d939', '8c4863bc-a2a3-4a19-ac19-fb74b5918190', '089c30aa-3b8d-4ad2-a8df-4b9aeaeb0c03'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:32:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:32:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:32:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:32:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:32:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:32:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:53 devstack sudo[106859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:32:53 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:54 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.325s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG cinder.manager [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:32:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Deleted volume successfully.
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [req-95b329d8-a8cb-456a-bbfd-5d32dd91f08d req-1e8fb42b-f6a8-4a27-8859-2266a5d1855b tempest-TestShelveInstance-108306881 None] Lock "cinder-9d232991-050d-427e-8873-6a79073ee9e3-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:32:54 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:32:54 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:32:54 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.303s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:32:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:33:03 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=35,cinder:SELECT=28,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:33:04 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=33,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Flow 'volume_create_manager' (97e3ea85-2bde-43f7-bc02-f6e34a13302f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb669e33-dbda-4045-94a4-fc26d7710a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb669e33-dbda-4045-94a4-fc26d7710a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-375241485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dedcde0a-5c48-4487-889e-797c3930694e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e482649ac247ebace85e170a8e9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:27Z,use_quota=True,user_id='4168659466c74b0786d3f715661c384a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4bbf6f-fa6b-49d0-9eab-accbc08fc7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4bbf6f-fa6b-49d0-9eab-accbc08fc7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc046eb-bd36-48ea-a341-f659bfa7baf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc046eb-bd36-48ea-a341-f659bfa7baf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dedcde0a-5c48-4487-889e-797c3930694e', 'volume_name': 'volume-dedcde0a-5c48-4487-889e-797c3930694e', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e7c985-4bdf-47e4-8950-b9b0daabf940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e7c985-4bdf-47e4-8950-b9b0daabf940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d27eee-a7cb-425a-90c7-f40bc80a93a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:33:27 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Volume dedcde0a-5c48-4487-889e-797c3930694e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dedcde0a-5c48-4487-889e-797c3930694e', 'volume_size': 1}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-375241485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dedcde0a-5c48-4487-889e-797c3930694e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e482649ac247ebace85e170a8e9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:27Z,use_quota=True,user_id='4168659466c74b0786d3f715661c384a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Creating volume dedcde0a-5c48-4487-889e-797c3930694e {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:33:27 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:33:27 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e 1073741824
Sep 29 18:33:27 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:33:27 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e 1073741824" returned: 0 in 0.422s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:33:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:33:27 devstack sudo[106883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e
Sep 29 18:33:27 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:33:28 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root
Sep 29 18:33:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e" returned: 0 in 0.253s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:33:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:33:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:33:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d27eee-a7cb-425a-90c7-f40bc80a93a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dedcde0a-5c48-4487-889e-797c3930694e', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:33:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650ae7ed-1323-4f0a-b8ec-03360d01d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:33:28 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Volume volume-dedcde0a-5c48-4487-889e-797c3930694e (dedcde0a-5c48-4487-889e-797c3930694e): created successfully
Sep 29 18:33:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650ae7ed-1323-4f0a-b8ec-03360d01d4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:33:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Flow 'volume_create_manager' (97e3ea85-2bde-43f7-bc02-f6e34a13302f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:33:28 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-31067b41-274e-4dbc-93c4-357dfca76e7c tempest-TestImageHashVerification-1812961778 None] Created volume successfully.
Sep 29 18:33:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:33:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:33:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a9399c-1ef0-49ba-b6ce-f34ebea8637f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:33:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:33:29 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e
Sep 29 18:33:29 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:33:29 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Sep 29 18:33:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e" returned: 0 in 0.359s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:33:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8dc77a-9364-42ac-8a47-0f8e63ce4d13]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:33:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:33:29 devstack sudo[106903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e
Sep 29 18:33:29 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:33:29 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root
Sep 29 18:33:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e" returned: 0 in 0.363s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:33:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e /opt/stack/data/cinder/conversion/dedcde0a-5c48-4487-889e-797c3930694e.temp_image.3af2afea-5f03-4d34-aebe-cf89252b7e0afl3d_w2t.img {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:33:29 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e /opt/stack/data/cinder/conversion/dedcde0a-5c48-4487-889e-797c3930694e.temp_image.3af2afea-5f03-4d34-aebe-cf89252b7e0afl3d_w2t.img
Sep 29 18:33:29 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:33:35 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Sep 29 18:33:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e /opt/stack/data/cinder/conversion/dedcde0a-5c48-4487-889e-797c3930694e.temp_image.3af2afea-5f03-4d34-aebe-cf89252b7e0afl3d_w2t.img" returned: 0 in 5.729s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:33:35 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaeb0b2-4ef6-40e3-9e09-fef15ba3ad86]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:33:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:33:35 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e
Sep 29 18:33:35 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:33:36 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Sep 29 18:33:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e" returned: 0 in 0.569s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:33:36 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/conversion/dedcde0a-5c48-4487-889e-797c3930694e.temp_image.3af2afea-5f03-4d34-aebe-cf89252b7e0afl3d_w2t.img {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:33:36 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] Converted 1024.00 MB image at 178.71 MB/s
Sep 29 18:33:36 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] 3af2afea-5f03-4d34-aebe-cf89252b7e0a was raw, no need to convert to raw {{(pid=86821) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 29 18:33:46 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:33:46 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:33:54 devstack sudo[106961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:33:54 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.579s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] Uploaded volume to glance image-id: 3af2afea-5f03-4d34-aebe-cf89252b7e0a. {{(pid=86821) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 29 18:33:54 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.249s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:33:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:33:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-4701740b-fb79-4dae-b2ac-2b0eb1b815a0 tempest-TestImageHashVerification-1812961778 None] Copy volume to image completed successfully.
Sep 29 18:33:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Acquiring lock "cinder-dedcde0a-5c48-4487-889e-797c3930694e-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:33:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Lock "cinder-dedcde0a-5c48-4487-889e-797c3930694e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:33:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Acquiring lock "cinder-quobyte-dedcde0a-5c48-4487-889e-797c3930694e" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:33:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Lock "cinder-quobyte-dedcde0a-5c48-4487-889e-797c3930694e" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:33:55 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d1317c-317e-4e2a-9170-ff425030769c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:33:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:33:55 devstack sudo[106964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e
Sep 29 18:33:55 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:33:55 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root
Sep 29 18:33:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e" returned: 0 in 0.358s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:33:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:33:55 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e
Sep 29 18:33:55 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:33:56 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-dedcde0a-5c48-4487-889e-797c3930694e" returned: 0 in 0.271s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Lock "cinder-quobyte-dedcde0a-5c48-4487-889e-797c3930694e" released by "delete_volume" :: held 0.671s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Created reservations ['70f645e3-4b20-4b71-bc24-45923aba37e1', 'af1147ba-754f-4a4a-af37-01b24a9a0483', '08ea43f1-8dca-4132-9941-e3d665e7f164', 'da0168f9-c967-49df-a794-bd33a2107672'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:33:56 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:33:56 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:33:56 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.252s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:33:56 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Deleted volume successfully.
Sep 29 18:33:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1bd8c225-be07-4862-a77e-00756a6efbcc tempest-TestImageHashVerification-1812961778 None] Lock "cinder-dedcde0a-5c48-4487-889e-797c3930694e-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:06 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:34:06 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=1 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Flow 'volume_create_manager' (e4692227-fe1c-4f74-a48c-5007e8445be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3ff941-1768-4c48-97cb-26431dad206d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3ff941-1768-4c48-97cb-26431dad206d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1409396737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7ead02-8db0-44c0-8c61-ac39aa3389dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c2d81a914446098f10eec695c2c525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:22Z,use_quota=True,user_id='2140f6e32fda41b2ae9528c0507f9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81a8dad-45b4-4673-bd16-891a718e981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81a8dad-45b4-4673-bd16-891a718e981c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d4b2dc-dc0c-40c5-a171-6ce786e3315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d4b2dc-dc0c-40c5-a171-6ce786e3315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb7ead02-8db0-44c0-8c61-ac39aa3389dd', 'volume_name': 'volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409f1005-2374-437d-8255-164cb30e95c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409f1005-2374-437d-8255-164cb30e95c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9de33b-8cef-46b3-9ec7-d99b9844cb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:21 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Volume eb7ead02-8db0-44c0-8c61-ac39aa3389dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd', 'volume_size': 1}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1409396737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7ead02-8db0-44c0-8c61-ac39aa3389dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c2d81a914446098f10eec695c2c525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:22Z,use_quota=True,user_id='2140f6e32fda41b2ae9528c0507f9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Creating volume eb7ead02-8db0-44c0-8c61-ac39aa3389dd {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:21 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:21 devstack sudo[107024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd 1073741824
Sep 29 18:34:21 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:21 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (968db51d-7371-48ef-ae02-9b1e7f25cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a116f8c1-9ad1-449e-b18e-af79b232aad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a116f8c1-9ad1-449e-b18e-af79b232aad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148450158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff47078-0ea6-4701-8fcf-275ede2c1958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:22Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafa70a8-f4dc-4ba2-8338-c83997e90724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafa70a8-f4dc-4ba2-8338-c83997e90724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0609ff8b-700c-4c97-b978-297c3ab96eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0609ff8b-700c-4c97-b978-297c3ab96eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff47078-0ea6-4701-8fcf-275ede2c1958', 'volume_name': 'volume-cff47078-0ea6-4701-8fcf-275ede2c1958', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81abd618-ac39-4e3b-879d-593313b26253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81abd618-ac39-4e3b-879d-593313b26253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4cb98f-24ad-4d94-a74b-803087054640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume cff47078-0ea6-4701-8fcf-275ede2c1958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff47078-0ea6-4701-8fcf-275ede2c1958', 'volume_size': 1}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Flow 'volume_create_manager' (53912327-27fa-4a6a-8d85-40a9fb68a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682811b5-ca94-48ed-ba01-c2686aec81e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682811b5-ca94-48ed-ba01-c2686aec81e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1320113691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d046840-f5c5-4737-97a0-47e474b405c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c2d81a914446098f10eec695c2c525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:22Z,use_quota=True,user_id='2140f6e32fda41b2ae9528c0507f9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5502eb7a-3be0-4d4c-9460-3e8bb63a8199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5502eb7a-3be0-4d4c-9460-3e8bb63a8199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889e7b22-a680-4edf-8077-c898d7eb61ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889e7b22-a680-4edf-8077-c898d7eb61ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d046840-f5c5-4737-97a0-47e474b405c1', 'volume_name': 'volume-7d046840-f5c5-4737-97a0-47e474b405c1', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ff9d8e-23e3-48d1-ae2f-ad3fc0baf245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ff9d8e-23e3-48d1-ae2f-ad3fc0baf245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0844b5fa-16ba-4da0-adf8-602c04580119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Volume 7d046840-f5c5-4737-97a0-47e474b405c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d046840-f5c5-4737-97a0-47e474b405c1', 'volume_size': 1}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:22 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd 1073741824" returned: 0 in 0.782s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Flow 'volume_create_manager' (44a29012-07f7-4b8e-93c4-bc19aef59e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b51224c-2693-4732-9b1a-404b327b45ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b51224c-2693-4732-9b1a-404b327b45ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055782671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0b091d-80f4-4d8e-be73-c9bf311f3975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c2d81a914446098f10eec695c2c525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:23Z,use_quota=True,user_id='2140f6e32fda41b2ae9528c0507f9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab4811bf-f845-4db1-880e-bbe878198400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab4811bf-f845-4db1-880e-bbe878198400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa75d216-cbbd-4606-8a5d-02ddb814d36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa75d216-cbbd-4606-8a5d-02ddb814d36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f0b091d-80f4-4d8e-be73-c9bf311f3975', 'volume_name': 'volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4d9299-2f6c-4c94-9484-e56a7579cbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4d9299-2f6c-4c94-9484-e56a7579cbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdb1eae-5b44-43fa-bca1-c91ade16b6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:22 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Volume 8f0b091d-80f4-4d8e-be73-c9bf311f3975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975', 'volume_size': 1}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:22 devstack sudo[107031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd
Sep 29 18:34:22 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:23 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd" returned: 0 in 0.388s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.129s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148450158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff47078-0ea6-4701-8fcf-275ede2c1958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:22Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Creating volume cff47078-0ea6-4701-8fcf-275ede2c1958 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:23 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:23 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958 1073741824
Sep 29 18:34:23 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Flow 'volume_create_manager' (7d550e81-aa9f-439c-af03-f422a9b2265f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567ed1d1-e9cb-4a58-a54f-d6f1b2990c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9de33b-8cef-46b3-9ec7-d99b9844cb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668a4a6e-dbd2-441e-88ba-247fc2be9f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567ed1d1-e9cb-4a58-a54f-d6f1b2990c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-554262104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c228e4-8fba-4d84-8b8f-e5415d690506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c2d81a914446098f10eec695c2c525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:23Z,use_quota=True,user_id='2140f6e32fda41b2ae9528c0507f9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24cb136-9fdb-4dd3-8147-42d676f85c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24cb136-9fdb-4dd3-8147-42d676f85c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cb2b88-838c-4c18-9f3a-4eb67df708f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cb2b88-838c-4c18-9f3a-4eb67df708f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17c228e4-8fba-4d84-8b8f-e5415d690506', 'volume_name': 'volume-17c228e4-8fba-4d84-8b8f-e5415d690506', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688bb351-368d-4aa7-b527-38815aa035f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688bb351-368d-4aa7-b527-38815aa035f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d951e8-fc67-4f18-84c5-af2a486eb07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:23 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Volume 17c228e4-8fba-4d84-8b8f-e5415d690506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17c228e4-8fba-4d84-8b8f-e5415d690506', 'volume_size': 1}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:23 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Volume volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd (eb7ead02-8db0-44c0-8c61-ac39aa3389dd): created successfully
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668a4a6e-dbd2-441e-88ba-247fc2be9f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Flow 'volume_create_manager' (e4692227-fe1c-4f74-a48c-5007e8445be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:23 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-72aeae2d-adea-46b0-a068-e2c708234207 tempest-CreateVolumesFromImageTest-2085779098 None] Created volume successfully.
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Flow 'volume_create_manager' (8b83805e-4f0d-4f00-b091-0345fda23cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c25e40e-74d0-4e01-96aa-0811c35caac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c25e40e-74d0-4e01-96aa-0811c35caac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1443129551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992f2914-4b15-4e37-bc11-f8b6cc2cc9b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c2d81a914446098f10eec695c2c525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:24Z,use_quota=True,user_id='2140f6e32fda41b2ae9528c0507f9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b936ce2-168d-43dc-b45a-5ee85b8c5cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b936ce2-168d-43dc-b45a-5ee85b8c5cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb299679-4d78-48d6-9ccc-979640d80f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb299679-4d78-48d6-9ccc-979640d80f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '992f2914-4b15-4e37-bc11-f8b6cc2cc9b6', 'volume_name': 'volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9396af94-ea49-4c2d-8302-a45f7415a82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9396af94-ea49-4c2d-8302-a45f7415a82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a607bd-fdb5-434c-84ed-6031168da4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:23 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Volume 992f2914-4b15-4e37-bc11-f8b6cc2cc9b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6', 'volume_size': 1}
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:23 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958 1073741824" returned: 0 in 0.703s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:24 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958
Sep 29 18:34:24 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:24 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958" returned: 0 in 0.284s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1320113691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d046840-f5c5-4737-97a0-47e474b405c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c2d81a914446098f10eec695c2c525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:22Z,use_quota=True,user_id='2140f6e32fda41b2ae9528c0507f9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Creating volume 7d046840-f5c5-4737-97a0-47e474b405c1 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:24 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4cb98f-24ad-4d94-a74b-803087054640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff47078-0ea6-4701-8fcf-275ede2c1958', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214369a2-121e-4962-9c6c-e6d92709dfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:24 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1 1073741824
Sep 29 18:34:24 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:24 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume volume-cff47078-0ea6-4701-8fcf-275ede2c1958 (cff47078-0ea6-4701-8fcf-275ede2c1958): created successfully
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214369a2-121e-4962-9c6c-e6d92709dfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (968db51d-7371-48ef-ae02-9b1e7f25cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ab800fd4-cfe5-4cc1-85c0-fce025cc6496 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created volume successfully.
Sep 29 18:34:24 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1 1073741824" returned: 0 in 0.614s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:25 devstack sudo[107050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1
Sep 29 18:34:25 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:25 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1" returned: 0 in 0.373s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.540s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055782671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0b091d-80f4-4d8e-be73-c9bf311f3975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c2d81a914446098f10eec695c2c525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:23Z,use_quota=True,user_id='2140f6e32fda41b2ae9528c0507f9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Creating volume 8f0b091d-80f4-4d8e-be73-c9bf311f3975 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:25 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0844b5fa-16ba-4da0-adf8-602c04580119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d046840-f5c5-4737-97a0-47e474b405c1', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:25 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975 1073741824
Sep 29 18:34:25 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fa9195-2651-4bf0-8e85-45334bfdfdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:25 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Volume volume-7d046840-f5c5-4737-97a0-47e474b405c1 (7d046840-f5c5-4737-97a0-47e474b405c1): created successfully
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fa9195-2651-4bf0-8e85-45334bfdfdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Flow 'volume_create_manager' (53912327-27fa-4a6a-8d85-40a9fb68a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:25 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-18773906-fd56-489a-b638-62428c149a7b tempest-CreateVolumesFromImageTest-2085779098 None] Created volume successfully.
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Flow 'volume_create_manager' (0162f81e-4fef-4bd5-97d2-1f9c04119cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f881f9-8192-4e98-92d0-8bdd291040b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f881f9-8192-4e98-92d0-8bdd291040b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13ebc7785eb49c1aeab28bfa7938adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:26Z,use_quota=True,user_id='0072f68d15de429490f87cf2f4c040c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7670602-8301-4298-bc05-41c437e3e77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7670602-8301-4298-bc05-41c437e3e77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9fce42-37fe-404f-a649-322c5918f4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.image.glance [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Creating Keystone auth plugin from conf {{(pid=86821) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (c6846807-9d4f-428d-9d0f-61fb1301e94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63af87b0-576f-4cd2-85ef-93b72894bf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63af87b0-576f-4cd2-85ef-93b72894bf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419498912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086b6c6b-dd92-44d1-ae3e-18b9207bedd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:26Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64db88fa-74e5-4ccd-af4e-478389c28e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64db88fa-74e5-4ccd-af4e-478389c28e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894388fb-c4fb-435b-99b1-042d137defcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894388fb-c4fb-435b-99b1-042d137defcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086b6c6b-dd92-44d1-ae3e-18b9207bedd5', 'volume_name': 'volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce010d63-47ab-4e66-b5f6-6cc8f6140392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce010d63-47ab-4e66-b5f6-6cc8f6140392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de249a5-2ae7-475b-b413-cb2fb9e6392e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume 086b6c6b-dd92-44d1-ae3e-18b9207bedd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5', 'volume_size': 1}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:26 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975 1073741824" returned: 0 in 0.801s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:26 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975
Sep 29 18:34:26 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (69c9fb73-92b0-47ef-940a-226df3fc9f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb6f1ca-1a38-466e-833b-cdd7efa28c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb6f1ca-1a38-466e-833b-cdd7efa28c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1245226017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63752efb-8e09-4825-99a4-15dd07e53959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:26Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc87612-d54c-4cf5-9f61-bc26608f4d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc87612-d54c-4cf5-9f61-bc26608f4d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e32b4a-995f-4cc5-b718-179d4c261ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e32b4a-995f-4cc5-b718-179d4c261ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63752efb-8e09-4825-99a4-15dd07e53959', 'volume_name': 'volume-63752efb-8e09-4825-99a4-15dd07e53959', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bd2148-fe6e-417b-b41d-2392daba3a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bd2148-fe6e-417b-b41d-2392daba3a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562e6203-dcce-446e-80c4-f97e5e752228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume 63752efb-8e09-4825-99a4-15dd07e53959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63752efb-8e09-4825-99a4-15dd07e53959', 'volume_size': 1}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9fce42-37fe-404f-a649-322c5918f4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5', 'volume_name': 'volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5', 'volume_size': 1, 'image_id': '1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc461eb4e6e5920105d30ac1326920db', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b13ebc7785eb49c1aeab28bfa7938adb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef64b4f2eef84b42fb51bd20ce48a04bb264d9461ff520018d415f3971390ac72374bfb9ca5f90c48dfb53189a367c4cfb0a2f4bd12b289db48dfcff3ee76179', 'id': '1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'created_at': datetime.datetime(2026, 9, 29, 16, 34, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 34, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cb8ab49-578f-49eb-94b6-42c66c9a9abc/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c570290>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b4e000-b8be-424f-ba6d-69251b5b72d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b4e000-b8be-424f-ba6d-69251b5b72d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b98beb-d511-43cd-8d0a-33b406362534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Volume c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5', 'volume_size': 1, 'image_id': '1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc461eb4e6e5920105d30ac1326920db', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b13ebc7785eb49c1aeab28bfa7938adb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef64b4f2eef84b42fb51bd20ce48a04bb264d9461ff520018d415f3971390ac72374bfb9ca5f90c48dfb53189a367c4cfb0a2f4bd12b289db48dfcff3ee76179', 'id': '1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'created_at': datetime.datetime(2026, 9, 29, 16, 34, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 34, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cb8ab49-578f-49eb-94b6-42c66c9a9abc/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c570290>}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Trying to clone c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 from image 1cb8ab49-578f-49eb-94b6-42c66c9a9abc at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'metadata': {}}]). {{(pid=86821) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975" returned: 0 in 0.347s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.170s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-554262104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c228e4-8fba-4d84-8b8f-e5415d690506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c2d81a914446098f10eec695c2c525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:23Z,use_quota=True,user_id='2140f6e32fda41b2ae9528c0507f9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Creating volume 17c228e4-8fba-4d84-8b8f-e5415d690506 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:26 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdb1eae-5b44-43fa-bca1-c91ade16b6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65dcf34c-4a95-431e-b1dc-758c8ff3eea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:26 devstack sudo[107061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506 1073741824
Sep 29 18:34:26 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Volume volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975 (8f0b091d-80f4-4d8e-be73-c9bf311f3975): created successfully
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65dcf34c-4a95-431e-b1dc-758c8ff3eea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Flow 'volume_create_manager' (44a29012-07f7-4b8e-93c4-bc19aef59e1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 18:34:26 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 18:34:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0de1fedd-4c82-4c6e-8b9b-6e7f2501b782 tempest-CreateVolumesFromImageTest-2085779098 None] Created volume successfully.
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[631b05d4-7cf1-4ab8-96d6-ef83e1738093]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:27 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD
Sep 29 18:34:27 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:27 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506 1073741824" returned: 0 in 0.718s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:27 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:27 devstack sudo[107073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506
Sep 29 18:34:27 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:27 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD
Sep 29 18:34:27 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (d11e42d2-73b6-4e69-a14c-8ebf7905276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1988d763-060c-4629-a3a1-aefea51d160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1988d763-060c-4629-a3a1-aefea51d160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1671072528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471cbd68-120f-4fcd-bde5-8b0f32794b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:27Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f77019-57ec-42da-b5dd-24f7f3a4b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f77019-57ec-42da-b5dd-24f7f3a4b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9a98a0-4406-4eaa-86fc-ba88122c0004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9a98a0-4406-4eaa-86fc-ba88122c0004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '471cbd68-120f-4fcd-bde5-8b0f32794b88', 'volume_name': 'volume-471cbd68-120f-4fcd-bde5-8b0f32794b88', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a17e8f2-b558-4dcf-bf47-3ee741a1a2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a17e8f2-b558-4dcf-bf47-3ee741a1a2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895f1a83-08be-41bf-bec4-a5ec986204d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:27 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume 471cbd68-120f-4fcd-bde5-8b0f32794b88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-471cbd68-120f-4fcd-bde5-8b0f32794b88', 'volume_size': 1}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:27 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506" returned: 0 in 0.348s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.825s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1443129551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992f2914-4b15-4e37-bc11-f8b6cc2cc9b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c2d81a914446098f10eec695c2c525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:24Z,use_quota=True,user_id='2140f6e32fda41b2ae9528c0507f9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Creating volume 992f2914-4b15-4e37-bc11-f8b6cc2cc9b6 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:27 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:27 devstack sudo[107079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6 1073741824
Sep 29 18:34:27 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d951e8-fc67-4f18-84c5-af2a486eb07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17c228e4-8fba-4d84-8b8f-e5415d690506', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4830d33c-bd6d-495a-8ba6-52d37a6b0c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:27 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Volume volume-17c228e4-8fba-4d84-8b8f-e5415d690506 (17c228e4-8fba-4d84-8b8f-e5415d690506): created successfully
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4830d33c-bd6d-495a-8ba6-52d37a6b0c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Flow 'volume_create_manager' (7d550e81-aa9f-439c-af03-f422a9b2265f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-146df25f-56da-43cd-9332-de79faadf87b tempest-CreateVolumesFromImageTest-2085779098 None] Created volume successfully.
Sep 29 18:34:27 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD" returned: 1 in 0.497s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:34:27 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Temporary image 1cb8ab49-578f-49eb-94b6-42c66c9a9abc is fetched for user 0072f68d15de429490f87cf2f4c040c6. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Flow 'volume_create_manager' (18905730-4565-4b61-baae-d6c1767c0a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127108a5-a97d-4c8a-a589-cca3297e8db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (3b49095b-743c-45b3-acef-7a80d67e0c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2794b3a-0f11-49f9-b50e-dbc61adab244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[94951e33-cd7d-461d-82f3-7c879d34c8cb]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127108a5-a97d-4c8a-a589-cca3297e8db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b839b9e3-78fa-4cae-b6ee-6410cad1ddd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8c373e6e694cf2a0ae9b3aebc1685e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:28Z,use_quota=True,user_id='441ce770234c4159819592f54fb1f6a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3eb9b206-3fc3-49a3-852a-e1fbf92ec0dd),volume_type_id=3eb9b206-3fc3-49a3-852a-e1fbf92ec0dd)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1216d6-a803-40c5-8439-f1e47cf62901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1216d6-a803-40c5-8439-f1e47cf62901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673d992c-e6fd-4610-9785-0c476e78d98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.image.glance [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Creating Keystone auth plugin from conf {{(pid=86821) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2794b3a-0f11-49f9-b50e-dbc61adab244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656496761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2250e3e9-e451-4bc7-89fd-868176e8caa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:28Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eeac46-998e-4302-8771-ea41acebb353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eeac46-998e-4302-8771-ea41acebb353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dd145f-a4e0-49d0-a8c3-577c9a9cf504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dd145f-a4e0-49d0-a8c3-577c9a9cf504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2250e3e9-e451-4bc7-89fd-868176e8caa5', 'volume_name': 'volume-2250e3e9-e451-4bc7-89fd-868176e8caa5', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3c1935-2383-46aa-b1e6-676444f1367c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3c1935-2383-46aa-b1e6-676444f1367c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39377965-37f7-452c-ba4e-cb235f35d0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume 2250e3e9-e451-4bc7-89fd-868176e8caa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2250e3e9-e451-4bc7-89fd-868176e8caa5', 'volume_size': 1}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:28 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD
Sep 29 18:34:28 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (55d1fb65-49d9-42c8-9b88-f98f1572a6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca89699-865f-49a7-a95b-e14805854640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca89699-865f-49a7-a95b-e14805854640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-466676232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb83713-d0e1-44cf-9715-4942d7017edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:28Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e6d55a-e52e-4536-8ef0-fc5e849423b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e6d55a-e52e-4536-8ef0-fc5e849423b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c92edf-8f91-41a0-a493-26a94ad96b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c92edf-8f91-41a0-a493-26a94ad96b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb83713-d0e1-44cf-9715-4942d7017edd', 'volume_name': 'volume-acb83713-d0e1-44cf-9715-4942d7017edd', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2593c740-6c4a-4202-a604-ba53711a2174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2593c740-6c4a-4202-a604-ba53711a2174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348a2a4c-cf16-4ce6-be10-614fadfa39fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume acb83713-d0e1-44cf-9715-4942d7017edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb83713-d0e1-44cf-9715-4942d7017edd', 'volume_size': 1}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:28 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6 1073741824" returned: 0 in 0.640s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673d992c-e6fd-4610-9785-0c476e78d98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b839b9e3-78fa-4cae-b6ee-6410cad1ddd8', 'volume_name': 'volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8', 'volume_size': 1, 'image_id': '4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b59b8ccf1c52a7356a0b90a78665c953', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a8c373e6e694cf2a0ae9b3aebc1685e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e3f3e76de387e168ca7732137b5f91da07818a2758f4657290950bd535ffc1de2d25034195dae606ced992dd6c0002e1950a9b13464be1301349da580717897', 'id': '4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'created_at': datetime.datetime(2026, 9, 29, 16, 34, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 34, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b97028890>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a82eb90-35db-49f7-832d-08e366e759a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a82eb90-35db-49f7-832d-08e366e759a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd42ca3-7f3d-485a-9c7f-bdf04d4a0882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Volume b839b9e3-78fa-4cae-b6ee-6410cad1ddd8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8', 'volume_size': 1, 'image_id': '4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b59b8ccf1c52a7356a0b90a78665c953', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a8c373e6e694cf2a0ae9b3aebc1685e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e3f3e76de387e168ca7732137b5f91da07818a2758f4657290950bd535ffc1de2d25034195dae606ced992dd6c0002e1950a9b13464be1301349da580717897', 'id': '4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'created_at': datetime.datetime(2026, 9, 29, 16, 34, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 34, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b97028890>}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Trying to clone b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 from image 4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'metadata': {}}]). {{(pid=86821) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:28 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:28 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6
Sep 29 18:34:28 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 29 18:34:28 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Image download 0.00 MB at 0.00 MB/s
Sep 29 18:34:28 devstack sudo[107093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD
Sep 29 18:34:28 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce9ca3c-0899-49e1-b56a-f184c4ec0bed]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:28 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6" returned: 0 in 0.271s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.644s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419498912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086b6c6b-dd92-44d1-ae3e-18b9207bedd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:26Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Creating volume 086b6c6b-dd92-44d1-ae3e-18b9207bedd5 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:28 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD
Sep 29 18:34:28 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:28 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a607bd-fdb5-434c-84ed-6031168da4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5 1073741824
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c1df89-606c-4272-9db9-2f012ecec816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:28 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:28 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Volume volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6 (992f2914-4b15-4e37-bc11-f8b6cc2cc9b6): created successfully
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c1df89-606c-4272-9db9-2f012ecec816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:28 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Flow 'volume_create_manager' (8b83805e-4f0d-4f00-b091-0345fda23cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:34:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:28 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e9e13ba5-3809-4189-aec4-2eb67ff05c9e tempest-CreateVolumesFromImageTest-2085779098 None] Created volume successfully.
Sep 29 18:34:29 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:29 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD
Sep 29 18:34:29 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:29 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5 1073741824" returned: 0 in 0.553s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:29 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5
Sep 29 18:34:29 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:29 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Temporary image 4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f is fetched for user 441ce770234c4159819592f54fb1f6a5. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03fe016-805e-40a7-9776-16a1c738de81]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:29 devstack sudo[107117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD
Sep 29 18:34:29 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "cinder-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:29 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5" returned: 0 in 0.292s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.155s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1245226017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63752efb-8e09-4825-99a4-15dd07e53959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:26Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Creating volume 63752efb-8e09-4825-99a4-15dd07e53959 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:29 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:29 devstack sudo[107120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959 1073741824
Sep 29 18:34:29 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de249a5-2ae7-475b-b413-cb2fb9e6392e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25727b98-8cd4-4ef4-8dc1-45e90c6ad581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:29 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5 (086b6c6b-dd92-44d1-ae3e-18b9207bedd5): created successfully
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25727b98-8cd4-4ef4-8dc1-45e90c6ad581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (c6846807-9d4f-428d-9d0f-61fb1301e94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "cinder-quobyte-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:29 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-436acba0-4239-4e80-9604-fe259b6615a0 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created volume successfully.
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-quobyte-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:29 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e44a22-6037-4a3e-8cbc-772de343ccbb]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:30 devstack sudo[107138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD
Sep 29 18:34:30 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:30 devstack sudo[107151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6
Sep 29 18:34:30 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:30 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959 1073741824" returned: 0 in 0.576s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:30 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959
Sep 29 18:34:30 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:30 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:30 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6" returned: 0 in 0.516s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD" returned: 1 in 0.541s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:30 devstack sudo[107176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6
Sep 29 18:34:30 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:30 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959" returned: 0 in 0.280s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.877s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1671072528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471cbd68-120f-4fcd-bde5-8b0f32794b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:27Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Creating volume 471cbd68-120f-4fcd-bde5-8b0f32794b88 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:30 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562e6203-dcce-446e-80c4-f97e5e752228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63752efb-8e09-4825-99a4-15dd07e53959', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:30 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88 1073741824
Sep 29 18:34:30 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b3faf4-3b26-470a-b168-918c7d210ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:30 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume volume-63752efb-8e09-4825-99a4-15dd07e53959 (63752efb-8e09-4825-99a4-15dd07e53959): created successfully
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b3faf4-3b26-470a-b168-918c7d210ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (69c9fb73-92b0-47ef-940a-226df3fc9f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:30 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6" returned: 0 in 0.287s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ff931402-a9b3-4bd8-944b-b6bd8c49c19e tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created volume successfully.
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-quobyte-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6" released by "delete_volume" :: held 0.898s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Created reservations ['cd4179fc-b4d3-4866-afef-6d251eff188c', '19e59275-57de-412f-b452-3810c5c6f5bc', '5e0dd617-eadd-4234-94af-c851d40169b4', '030db74e-8a36-4e4a-9a18-9a7370623baf'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:30 devstack sudo[107182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:30 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "cinder-17c228e4-8fba-4d84-8b8f-e5415d690506-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-17c228e4-8fba-4d84-8b8f-e5415d690506-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "cinder-quobyte-17c228e4-8fba-4d84-8b8f-e5415d690506" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:30 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-quobyte-17c228e4-8fba-4d84-8b8f-e5415d690506" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0117ed-f68e-4035-b462-cfc3c5ed2f66]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:31 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506
Sep 29 18:34:31 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:31 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.314s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:31 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88 1073741824" returned: 0 in 0.530s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Deleted volume successfully.
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-96c243a7-f01e-4bcc-a11c-c1807a6b8d62 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-992f2914-4b15-4e37-bc11-f8b6cc2cc9b6-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:31 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88
Sep 29 18:34:31 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:31 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506" returned: 0 in 0.427s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:31 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506
Sep 29 18:34:31 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:31 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88" returned: 0 in 0.278s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.258s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656496761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2250e3e9-e451-4bc7-89fd-868176e8caa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:28Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Creating volume 2250e3e9-e451-4bc7-89fd-868176e8caa5 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:31 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:31 devstack sudo[107205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5 1073741824
Sep 29 18:34:31 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895f1a83-08be-41bf-bec4-a5ec986204d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471cbd68-120f-4fcd-bde5-8b0f32794b88', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054ef520-e2ed-4254-8d44-ea5cdc3990a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:31 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume volume-471cbd68-120f-4fcd-bde5-8b0f32794b88 (471cbd68-120f-4fcd-bde5-8b0f32794b88): created successfully
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054ef520-e2ed-4254-8d44-ea5cdc3990a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (d11e42d2-73b6-4e69-a14c-8ebf7905276b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-4ac5bc47-11f3-4031-91a7-ae3dcbfbb0fc tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created volume successfully.
Sep 29 18:34:31 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-17c228e4-8fba-4d84-8b8f-e5415d690506" returned: 0 in 0.261s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-quobyte-17c228e4-8fba-4d84-8b8f-e5415d690506" released by "delete_volume" :: held 0.733s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Created reservations ['a0da53a8-8d50-462c-bd10-8e8d6967c128', 'd96cf498-bba3-40ea-8515-a8e02a13cf3b', '28304529-26fa-480f-80f8-cb6af94d7ea4', '5f97877e-1cc2-41e1-b23c-ae02458377f6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:31 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:31 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:31 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5 1073741824" returned: 0 in 0.475s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:32 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5
Sep 29 18:34:32 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:32 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.274s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:32 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Deleted volume successfully.
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7b5b1660-2c6f-4e3d-a9f6-e7632155d4c8 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-17c228e4-8fba-4d84-8b8f-e5415d690506-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:32 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5" returned: 0 in 0.279s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.938s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-466676232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb83713-d0e1-44cf-9715-4942d7017edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f532fbd6d14c65bfa0c61ca72e5653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:28Z,use_quota=True,user_id='8e89f551254143d58fbc50adcffa4601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Creating volume acb83713-d0e1-44cf-9715-4942d7017edd {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:32 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "cinder-8f0b091d-80f4-4d8e-be73-c9bf311f3975-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:32 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd 1073741824
Sep 29 18:34:32 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39377965-37f7-452c-ba4e-cb235f35d0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2250e3e9-e451-4bc7-89fd-868176e8caa5', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d5f583-4ac6-4b6b-8cfc-dd290882a5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-8f0b091d-80f4-4d8e-be73-c9bf311f3975-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:32 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume volume-2250e3e9-e451-4bc7-89fd-868176e8caa5 (2250e3e9-e451-4bc7-89fd-868176e8caa5): created successfully
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d5f583-4ac6-4b6b-8cfc-dd290882a5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (3b49095b-743c-45b3-acef-7a80d67e0c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:32 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-08649aeb-8b40-4e72-b122-15ae58fad77b tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created volume successfully.
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "cinder-quobyte-8f0b091d-80f4-4d8e-be73-c9bf311f3975" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-quobyte-8f0b091d-80f4-4d8e-be73-c9bf311f3975" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c2456a-a633-497f-8002-7b29f48e461b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:32 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975
Sep 29 18:34:32 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:32 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd 1073741824" returned: 0 in 0.501s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:32 devstack sudo[107229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd
Sep 29 18:34:32 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:32 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975" returned: 0 in 0.383s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:32 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975
Sep 29 18:34:32 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:33 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd" returned: 0 in 0.242s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.168s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13ebc7785eb49c1aeab28bfa7938adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:26Z,use_quota=True,user_id='0072f68d15de429490f87cf2f4c040c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Creating volume c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:33 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348a2a4c-cf16-4ce6-be10-614fadfa39fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb83713-d0e1-44cf-9715-4942d7017edd', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:33 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 1073741824
Sep 29 18:34:33 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2030dd0b-0e77-459d-9eb8-308a39156d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:33 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Volume volume-acb83713-d0e1-44cf-9715-4942d7017edd (acb83713-d0e1-44cf-9715-4942d7017edd): created successfully
Sep 29 18:34:33 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2030dd0b-0e77-459d-9eb8-308a39156d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Flow 'volume_create_manager' (55d1fb65-49d9-42c8-9b88-f98f1572a6a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-8f0b091d-80f4-4d8e-be73-c9bf311f3975" returned: 0 in 0.259s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-quobyte-8f0b091d-80f4-4d8e-be73-c9bf311f3975" released by "delete_volume" :: held 0.708s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:33 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ef844703-6dcc-436c-85eb-0b64311a7885 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created volume successfully.
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Created reservations ['2b963e82-a20d-4e19-83dd-d7813b50af4d', '1f143a18-deb5-4c37-aa40-1439d9bc481e', '9e38ec79-79cd-4f13-b43f-1e29388544db', 'a2435263-30f3-4e24-8c65-e7c235273a43'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:33 devstack sudo[107240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:33 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "cinder-7d046840-f5c5-4737-97a0-47e474b405c1-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-7d046840-f5c5-4737-97a0-47e474b405c1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "cinder-quobyte-7d046840-f5c5-4737-97a0-47e474b405c1" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:33 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.281s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-quobyte-7d046840-f5c5-4737-97a0-47e474b405c1" acquired by "delete_volume" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:33 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Deleted volume successfully.
Sep 29 18:34:33 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 1073741824" returned: 0 in 0.552s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6acd42-6430-493e-8d46-7afc5d584ec2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a8a39355-670c-4aaa-a718-9bc9dd533cf9 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-8f0b091d-80f4-4d8e-be73-c9bf311f3975-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:33 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5
Sep 29 18:34:33 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-acb83713-d0e1-44cf-9715-4942d7017edd-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-acb83713-d0e1-44cf-9715-4942d7017edd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:33 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1
Sep 29 18:34:33 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-quobyte-acb83713-d0e1-44cf-9715-4942d7017edd" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-acb83713-d0e1-44cf-9715-4942d7017edd" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d09723d-c63d-4596-86ae-35c6b99aae50]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:33 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5" returned: 0 in 0.275s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.577s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b839b9e3-78fa-4cae-b6ee-6410cad1ddd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8c373e6e694cf2a0ae9b3aebc1685e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:28Z,use_quota=True,user_id='441ce770234c4159819592f54fb1f6a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3eb9b206-3fc3-49a3-852a-e1fbf92ec0dd),volume_type_id=3eb9b206-3fc3-49a3-852a-e1fbf92ec0dd)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Creating volume b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:34 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:34 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Attempting download of 1cb8ab49-578f-49eb-94b6-42c66c9a9abc ((None, [{'url': 'file:///opt/stack/data/glance/images/1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'metadata': {}}])) to volume c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1" returned: 0 in 0.470s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:34 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:34 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 1073741824
Sep 29 18:34:34 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:34 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[493dc72b-03d4-4340-bf84-dfebca761206]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:34 devstack sudo[107258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_9eiqy4zp {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:34 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:34 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_9eiqy4zp
Sep 29 18:34:34 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:34 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd" returned: 0 in 0.546s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:34 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd
Sep 29 18:34:34 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:34 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7d046840-f5c5-4737-97a0-47e474b405c1" returned: 0 in 0.382s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-quobyte-7d046840-f5c5-4737-97a0-47e474b405c1" released by "delete_volume" :: held 0.928s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:34 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Created reservations ['e78f5057-a176-4242-949f-49d54cee69a2', 'ef5b6011-8167-49ee-9f71-4bf4a1cb3db4', '52b9a198-628e-4115-b9e7-092feace3159', '105a5288-0e63-47fd-9076-104789be754b'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_9eiqy4zp" returned: 0 in 0.455s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_9eiqy4zp {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:34 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 1073741824" returned: 0 in 0.743s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:34 devstack sudo[107273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_9eiqy4zp
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:34 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:34 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:34 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:34 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-acb83713-d0e1-44cf-9715-4942d7017edd" returned: 0 in 0.388s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:34 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-acb83713-d0e1-44cf-9715-4942d7017edd" released by "delete_volume" :: held 1.001s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:34 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:34 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created reservations ['a5a75b16-0b46-4f06-a1ea-046c099b8f41', '0285bdac-424e-44c7-a5cb-954e8d2fb1a7', 'f20d22d6-fac6-4501-b6a6-378a92b2d6a0', '8b69fe79-f642-44e7-8560-726266139d88'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:35 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_9eiqy4zp" returned: 1 in 0.396s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_9eiqy4zp' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e25b850-c354-45b1-a282-bf1af7302ed6]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:35 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:35 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:35 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.334s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:35 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Deleted volume successfully.
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2c09ccd9-39d6-4d2b-9b36-99f827912024 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-7d046840-f5c5-4737-97a0-47e474b405c1-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:35 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8" returned: 0 in 0.373s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:35 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:35 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Attempting download of 4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f ((None, [{'url': 'file:///opt/stack/data/glance/images/4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'metadata': {}}])) to volume b839b9e3-78fa-4cae-b6ee-6410cad1ddd8. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06190d7-627e-4ddf-aac1-e774a070fcfa]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_nelpu7kt {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:35 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.314s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:35 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Deleted volume successfully.
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fc6b6c34-9e74-47e3-b934-42d89422eee7 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-acb83713-d0e1-44cf-9715-4942d7017edd-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:35 devstack sudo[107288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_nelpu7kt
Sep 29 18:34:35 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:35 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:35 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD
Sep 29 18:34:35 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:35 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_nelpu7kt" returned: 0 in 0.369s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_nelpu7kt {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:35 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_nelpu7kt
Sep 29 18:34:35 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:35 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] 1cb8ab49-578f-49eb-94b6-42c66c9a9abc was raw, converting to qcow2 {{(pid=86821) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "cinder-eb7ead02-8db0-44c0-8c61-ac39aa3389dd-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:35 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5
Sep 29 18:34:35 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-eb7ead02-8db0-44c0-8c61-ac39aa3389dd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "cinder-quobyte-eb7ead02-8db0-44c0-8c61-ac39aa3389dd" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-quobyte-eb7ead02-8db0-44c0-8c61-ac39aa3389dd" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1d885f-94b2-472e-8d80-2faa94b8bf7c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:35 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:36 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-2250e3e9-e451-4bc7-89fd-868176e8caa5-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_nelpu7kt" returned: 1 in 0.389s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_nelpu7kt' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[901c97e8-ba1f-45d9-b91b-b229054dffc1]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:36 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd
Sep 29 18:34:36 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-2250e3e9-e451-4bc7-89fd-868176e8caa5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-quobyte-2250e3e9-e451-4bc7-89fd-868176e8caa5" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-2250e3e9-e451-4bc7-89fd-868176e8caa5" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3790780d-40d3-4e7a-b0ee-26aca9ed9e08]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:36 devstack sudo[107309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD
Sep 29 18:34:36 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:36 devstack sudo[107312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5
Sep 29 18:34:36 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:36 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5" returned: 0 in 0.598s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cb8ab49-578f-49eb-94b6-42c66c9a9abc_vcwf0qpqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:34:36 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:36 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd" returned: 0 in 0.474s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:36 devstack sudo[107319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 1G
Sep 29 18:34:36 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:36 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd
Sep 29 18:34:36 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:36 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:36 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD
Sep 29 18:34:36 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:36 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5" returned: 0 in 0.442s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:36 devstack sudo[107330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5
Sep 29 18:34:36 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:36 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-eb7ead02-8db0-44c0-8c61-ac39aa3389dd" returned: 0 in 0.345s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:36 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 1G" returned: 0 in 0.385s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Downloaded image 1cb8ab49-578f-49eb-94b6-42c66c9a9abc ((None, [{'url': 'file:///opt/stack/data/glance/images/1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'metadata': {}}])) to volume c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 successfully. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Temporary image 1cb8ab49-578f-49eb-94b6-42c66c9a9abc for user 0072f68d15de429490f87cf2f4c040c6 is deleted. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Marking volume c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 as bootable. {{(pid=86821) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-quobyte-eb7ead02-8db0-44c0-8c61-ac39aa3389dd" released by "delete_volume" :: held 0.894s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Copying metadata from image 1cb8ab49-578f-49eb-94b6-42c66c9a9abc to c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5. {{(pid=86821) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Creating volume glance metadata for volume c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 backed by image 1cb8ab49-578f-49eb-94b6-42c66c9a9abc with: {'image_id': '1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fc461eb4e6e5920105d30ac1326920db', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86821) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 18:34:36 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] 4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f was raw, converting to qcow2 {{(pid=86821) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:36 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8
Sep 29 18:34:36 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Created reservations ['a9b891e2-7314-479b-abc8-ef651688b3ae', '77bbdbae-ae10-4156-86bb-18c2a29fa639', '4a5ec2d0-e722-4b19-96fe-640f06a9e64c', '70eb9ddb-f412-4554-bac8-eee94d6821c6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:36 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2250e3e9-e451-4bc7-89fd-868176e8caa5" returned: 0 in 0.311s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-2250e3e9-e451-4bc7-89fd-868176e8caa5" released by "delete_volume" :: held 0.806s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b98beb-d511-43cd-8d0a-33b406362534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5', 'volume_size': 1, 'image_id': '1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc461eb4e6e5920105d30ac1326920db', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b13ebc7785eb49c1aeab28bfa7938adb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ef64b4f2eef84b42fb51bd20ce48a04bb264d9461ff520018d415f3971390ac72374bfb9ca5f90c48dfb53189a367c4cfb0a2f4bd12b289db48dfcff3ee76179', 'id': '1cb8ab49-578f-49eb-94b6-42c66c9a9abc', 'created_at': datetime.datetime(2026, 9, 29, 16, 34, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 34, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cb8ab49-578f-49eb-94b6-42c66c9a9abc/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b8c570290>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:36 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab6c212-93d6-47a7-b8c4-06a4e1cc43b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:37 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Volume volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 (c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5): created successfully
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab6c212-93d6-47a7-b8c4-06a4e1cc43b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Flow 'volume_create_manager' (0162f81e-4fef-4bd5-97d2-1f9c04119cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-23a66e66-3995-453f-8284-59c3862aafd3 tempest-VolumeImageDependencyTests-1162854158 None] Created volume successfully.
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created reservations ['4adb2d4a-ae3c-4fa5-9be6-1b754ae80b6a', 'abffb3e3-6ed6-4459-8165-5581d83d1e6a', 'ca12a737-ad50-420f-a3a0-19908c9e2047', '2dd6a7de-7a93-442e-98d5-5602b99f601a'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:37 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:37 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:37 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:37 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-471cbd68-120f-4fcd-bde5-8b0f32794b88-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-471cbd68-120f-4fcd-bde5-8b0f32794b88-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-quobyte-471cbd68-120f-4fcd-bde5-8b0f32794b88" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:37 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-471cbd68-120f-4fcd-bde5-8b0f32794b88" acquired by "delete_volume" :: waited 0.038s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.361s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Deleted volume successfully.
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[74012f81-09ff-4742-b4b4-649d46598e5f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:37 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8" returned: 0 in 0.598s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f_no8pqi1adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:34:37 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Converted 0.00 MB image at 0.00 MB/s
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f26fdf47-6acc-4d2e-8fdd-9da8b74e74e2 tempest-CreateVolumesFromImageTest-2085779098 None] Lock "cinder-eb7ead02-8db0-44c0-8c61-ac39aa3389dd-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:37 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 1G
Sep 29 18:34:37 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:37 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.333s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:37 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Deleted volume successfully.
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da056bce-5c19-4bb6-b5d5-814d644351fb tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-2250e3e9-e451-4bc7-89fd-868176e8caa5-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:37 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88
Sep 29 18:34:37 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Acquiring lock "cinder-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Lock "cinder-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Acquiring lock "cinder-quobyte-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:37 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 1G" returned: 0 in 0.397s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Downloaded image 4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f ((None, [{'url': 'file:///opt/stack/data/glance/images/4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'metadata': {}}])) to volume b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 successfully. {{(pid=86821) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Temporary image 4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f for user 441ce770234c4159819592f54fb1f6a5 is deleted. {{(pid=86821) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.volume.volume_utils [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Marking volume b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 as bootable. {{(pid=86821) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Lock "cinder-quobyte-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5" acquired by "delete_volume" :: waited 0.030s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:37 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Copying metadata from image 4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f to b839b9e3-78fa-4cae-b6ee-6410cad1ddd8. {{(pid=86821) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Creating volume glance metadata for volume b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 backed by image 4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b59b8ccf1c52a7356a0b90a78665c953', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86821) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88" returned: 0 in 0.464s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4e1fc7-beb4-486c-bad7-5013cb37aa26]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:37 devstack sudo[107366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88
Sep 29 18:34:37 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd42ca3-7f3d-485a-9c7f-bdf04d4a0882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8', 'volume_size': 1, 'image_id': '4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b59b8ccf1c52a7356a0b90a78665c953', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a8c373e6e694cf2a0ae9b3aebc1685e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e3f3e76de387e168ca7732137b5f91da07818a2758f4657290950bd535ffc1de2d25034195dae606ced992dd6c0002e1950a9b13464be1301349da580717897', 'id': '4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f', 'created_at': datetime.datetime(2026, 9, 29, 16, 34, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 34, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d4ccdf4-cce6-4ca1-98a5-2b2e4bb9432f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x784b97028890>}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdd2877-c2e2-413f-b37d-3d524f0a458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:38 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Volume volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 (b839b9e3-78fa-4cae-b6ee-6410cad1ddd8): created successfully
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdd2877-c2e2-413f-b37d-3d524f0a458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Flow 'volume_create_manager' (18905730-4565-4b61-baae-d6c1767c0a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:38 devstack sudo[107367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5
Sep 29 18:34:38 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:38 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-7d0e8e13-9336-4f5d-9a14-328c34b3ca72 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Created volume successfully.
Sep 29 18:34:38 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-471cbd68-120f-4fcd-bde5-8b0f32794b88" returned: 0 in 0.283s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-471cbd68-120f-4fcd-bde5-8b0f32794b88" released by "delete_volume" :: held 0.815s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created reservations ['652e5f36-4e38-47f4-a49b-984f6b9a2c20', '1e50ad41-7810-4e3f-9c52-93812edee9fd', 'e2e3f076-6f27-486c-81f1-53573cac7adf', 'e68398ff-ff47-4e3c-91ca-37b5e819e369'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:38 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5" returned: 0 in 0.423s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:38 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:38 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:38 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5
Sep 29 18:34:38 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-63752efb-8e09-4825-99a4-15dd07e53959-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-63752efb-8e09-4825-99a4-15dd07e53959-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-quobyte-63752efb-8e09-4825-99a4-15dd07e53959" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-63752efb-8e09-4825-99a4-15dd07e53959" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:38 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.310s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:38 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Deleted volume successfully.
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d5154-8424-439e-9201-da7392b88975]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6d3c5915-c342-409f-bc89-390bdf2139a2 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-471cbd68-120f-4fcd-bde5-8b0f32794b88-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:38 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5" returned: 0 in 0.374s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Lock "cinder-quobyte-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5" released by "delete_volume" :: held 0.854s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Created reservations ['31e1610c-489c-4773-aa3b-4080ed758fe9', 'c11a760b-d672-4657-a38f-908a777b312f', 'eba699a9-1da5-4e49-a56d-f1696b56656a', '44e98fb3-74a9-4704-b8e1-c91cf8be91b5'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:38 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959
Sep 29 18:34:38 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:38 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:38 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Acquiring lock "cinder-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Lock "cinder-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Acquiring lock "cinder-quobyte-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:39 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959" returned: 0 in 0.598s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:39 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Lock "cinder-quobyte-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8" acquired by "delete_volume" :: waited 0.038s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:39 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959
Sep 29 18:34:39 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.419s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:39 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Deleted volume successfully.
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fa8673-3f08-495c-b081-d959e946dd55]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0e1bc9d-7318-461d-8faa-62bdd16624e0 tempest-VolumeImageDependencyTests-1162854158 None] Lock "cinder-c2cce9ca-cbf1-45cc-aebe-079a61c3f6a5-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:39 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8
Sep 29 18:34:39 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:39 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-63752efb-8e09-4825-99a4-15dd07e53959" returned: 0 in 0.314s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-63752efb-8e09-4825-99a4-15dd07e53959" released by "delete_volume" :: held 0.986s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created reservations ['ec017c2f-080b-4b6f-8072-eec5b2c7aa84', '8e79d505-5903-4172-ade2-7046dbd15eba', 'fc165fa1-a76b-478a-8ef6-60c9be335198', '8166b40f-ccba-441e-86a9-4ad6d371fcc6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:39 devstack sudo[107396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:39 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:39 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8" returned: 0 in 0.562s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:39 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8
Sep 29 18:34:39 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:40 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.299s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Deleted volume successfully.
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-23d338fa-9d2c-4af1-99f1-667c9c6a8ee9 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-63752efb-8e09-4825-99a4-15dd07e53959-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:40 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8" returned: 0 in 0.350s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Lock "cinder-quobyte-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8" released by "delete_volume" :: held 0.979s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Created reservations ['2ae7fb32-d229-4ff7-9090-f98fc531e56c', 'b0e04c71-ba3f-4874-96e7-a288143e541d', '25e2f7a2-903d-4528-92fe-d09073dfbf74', '64497692-72b6-4679-8b2a-829a47d58a98'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:40 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:40 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:40 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.283s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Deleted volume successfully.
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c5fa409f-3e26-4bae-8bd9-f183e0d08641 tempest-VolumeAndVolumeTypeFromImageTest-557413311 None] Lock "cinder-b839b9e3-78fa-4cae-b6ee-6410cad1ddd8-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-086b6c6b-dd92-44d1-ae3e-18b9207bedd5-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-086b6c6b-dd92-44d1-ae3e-18b9207bedd5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-quobyte-086b6c6b-dd92-44d1-ae3e-18b9207bedd5" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-086b6c6b-dd92-44d1-ae3e-18b9207bedd5" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[60612bf9-3205-4a32-9ded-1aba6ed156d3]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:41 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5
Sep 29 18:34:41 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:41 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5" returned: 0 in 0.459s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:41 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5
Sep 29 18:34:41 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:41 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-086b6c6b-dd92-44d1-ae3e-18b9207bedd5" returned: 0 in 0.332s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-086b6c6b-dd92-44d1-ae3e-18b9207bedd5" released by "delete_volume" :: held 0.834s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created reservations ['c8a39124-e440-4f84-896b-21766d71dd84', '6de353d7-d4ac-4012-83e7-6df8943ca27a', '904f5152-bdef-4763-b323-69a2f6d7ba2e', '60f72eb0-38e0-45ed-8234-05c03d25c295'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:42 devstack sudo[107415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:42 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-cff47078-0ea6-4701-8fcf-275ede2c1958-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-cff47078-0ea6-4701-8fcf-275ede2c1958-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "cinder-quobyte-cff47078-0ea6-4701-8fcf-275ede2c1958" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-cff47078-0ea6-4701-8fcf-275ede2c1958" acquired by "delete_volume" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce31b9f-51e2-4b10-bb9c-b8266f189446]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:42 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.356s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:42 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Deleted volume successfully.
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c2c481f-2f94-49d4-809a-2849d3776883 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-086b6c6b-dd92-44d1-ae3e-18b9207bedd5-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:42 devstack sudo[107418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958
Sep 29 18:34:42 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:42 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958" returned: 0 in 0.394s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:42 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958
Sep 29 18:34:42 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:42 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-cff47078-0ea6-4701-8fcf-275ede2c1958" returned: 0 in 0.286s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:42 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-quobyte-cff47078-0ea6-4701-8fcf-275ede2c1958" released by "delete_volume" :: held 0.749s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Created reservations ['2c9c7756-7345-419d-bf16-0b58dfb36ee9', '80f418db-0216-4f52-b21f-693abb1203ba', '799a006e-7efc-4486-a71c-13c337616979', '4d90deda-dd7c-4258-a96b-6bbed4904b4f'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:43 devstack sudo[107428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:43 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (5dedf9a7-1efd-4fff-bb37-6e192aa4d6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820f8b08-1ea5-4d74-af2f-8fb7adfbd4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820f8b08-1ea5-4d74-af2f-8fb7adfbd4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355409084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88158dc-7ffa-4eeb-9d97-b22b71647217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:43Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03e59e7-4e5a-4c1f-98a4-729b5e4feca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03e59e7-4e5a-4c1f-98a4-729b5e4feca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a4503f-072d-41e1-9da8-a6e6783bc054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a4503f-072d-41e1-9da8-a6e6783bc054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88158dc-7ffa-4eeb-9d97-b22b71647217', 'volume_name': 'volume-b88158dc-7ffa-4eeb-9d97-b22b71647217', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8371f8-b0c0-43aa-90ac-6ff982216c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8371f8-b0c0-43aa-90ac-6ff982216c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8254bba3-1483-49f5-8e86-77f5f9ce4d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:43 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Volume b88158dc-7ffa-4eeb-9d97-b22b71647217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88158dc-7ffa-4eeb-9d97-b22b71647217', 'volume_size': 1}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355409084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88158dc-7ffa-4eeb-9d97-b22b71647217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:43Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Creating volume b88158dc-7ffa-4eeb-9d97-b22b71647217 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:43 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:43 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.562s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:43 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Deleted volume successfully.
Sep 29 18:34:43 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 1073741824
Sep 29 18:34:43 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6e16423b-b366-4ba1-84e4-ffaf21255642 tempest-CreateVolumesFromSourceVolumeTest-1689056264 None] Lock "cinder-cff47078-0ea6-4701-8fcf-275ede2c1958-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:44 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 1073741824" returned: 0 in 0.561s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:44 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217
Sep 29 18:34:44 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:44 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217" returned: 0 in 0.333s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8254bba3-1483-49f5-8e86-77f5f9ce4d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88158dc-7ffa-4eeb-9d97-b22b71647217', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1dc138-775b-4ad4-a6d2-c409dc42acdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:44 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Volume volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 (b88158dc-7ffa-4eeb-9d97-b22b71647217): created successfully
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1dc138-775b-4ad4-a6d2-c409dc42acdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (5dedf9a7-1efd-4fff-bb37-6e192aa4d6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:44 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-932c62c6-edaf-4ba0-b936-433d445c0c41 tempest-ProjectMemberTests-918657444 None] Created volume successfully.
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Flow 'volume_create_manager' (b3cd633b-86ef-4371-919d-08952c9d5ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132d704e-11db-456b-b059-1d80e42f7879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132d704e-11db-456b-b059-1d80e42f7879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961617780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e098dd-3a43-4e0f-995d-b0ff653cbb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3778b8376f34a1181f544e48746d29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:45Z,use_quota=True,user_id='d1f5c67a3ee14da4b9cc718c82a7d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b590d6bc-c828-46c0-a4b0-229f18bce3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b590d6bc-c828-46c0-a4b0-229f18bce3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccdc58c-883f-4988-97bc-4a5628649905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccdc58c-883f-4988-97bc-4a5628649905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e098dd-3a43-4e0f-995d-b0ff653cbb4a', 'volume_name': 'volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f8b99b-c9cc-47a8-90db-178e27e7b71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f8b99b-c9cc-47a8-90db-178e27e7b71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cff370-835f-4321-96ad-c5dd87336a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:44 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Volume 43e098dd-3a43-4e0f-995d-b0ff653cbb4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a', 'volume_size': 1}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961617780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e098dd-3a43-4e0f-995d-b0ff653cbb4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3778b8376f34a1181f544e48746d29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:45Z,use_quota=True,user_id='d1f5c67a3ee14da4b9cc718c82a7d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Creating volume 43e098dd-3a43-4e0f-995d-b0ff653cbb4a {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:44 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:44 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a 1073741824
Sep 29 18:34:44 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:45 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a 1073741824" returned: 0 in 0.642s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:45 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a
Sep 29 18:34:45 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:45 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cff370-835f-4321-96ad-c5dd87336a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb77ca7b-449f-43e7-87ab-9b5ad51de6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:45 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Volume volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a (43e098dd-3a43-4e0f-995d-b0ff653cbb4a): created successfully
Sep 29 18:34:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb77ca7b-449f-43e7-87ab-9b5ad51de6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Flow 'volume_create_manager' (b3cd633b-86ef-4371-919d-08952c9d5ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-af3d50f7-47cd-453f-846d-2841ab22873c tempest-ProjectReaderTests-1872108792 None] Created volume successfully.
Sep 29 18:34:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:46 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] Creating offline snapshot 1ab7cf32-2e02-4e58-b77b-50c21e5dba72 of volume b88158dc-7ffa-4eeb-9d97-b22b71647217 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:34:46 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03a4cfb-2d11-45ee-ac84-90cd92c58645]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:46 devstack sudo[107449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217
Sep 29 18:34:46 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:46 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217" returned: 0 in 0.381s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:46 devstack sudo[107454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72 1G
Sep 29 18:34:46 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:47 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72 1G" returned: 0 in 0.493s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:47 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72
Sep 29 18:34:47 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Acquiring lock "cinder-43e098dd-3a43-4e0f-995d-b0ff653cbb4a-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Lock "cinder-43e098dd-3a43-4e0f-995d-b0ff653cbb4a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Acquiring lock "cinder-quobyte-43e098dd-3a43-4e0f-995d-b0ff653cbb4a" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Lock "cinder-quobyte-43e098dd-3a43-4e0f-995d-b0ff653cbb4a" acquired by "delete_volume" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2ba111-4d9c-4efd-8753-a461e4df25c4]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:47 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a
Sep 29 18:34:47 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:47 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72" returned: 0 in 0.389s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:47 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72 is being set with open permissions: ugo+rw
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:47 devstack sudo[107467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72
Sep 29 18:34:47 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:47 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72" returned: 0 in 0.276s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:47 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a" returned: 0 in 0.492s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:47 devstack sudo[107474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.info
Sep 29 18:34:47 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:47 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a
Sep 29 18:34:47 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Flow 'volume_create_manager' (48fd7aee-b55e-496f-ace6-79739e316ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8323a477-af06-4a97-9878-773d619dd517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8323a477-af06-4a97-9878-773d619dd517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-282955017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092a84f2-29e4-4023-b3bc-a54c3a4761bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627fb5ed64224c2d9f2ad34bc0bc1f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:48Z,use_quota=True,user_id='e6fe5011a1b44062bd19f00c6ca21670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ad756f-8807-445c-9e4c-fdbfd34ead20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ad756f-8807-445c-9e4c-fdbfd34ead20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d56871-0883-4f9f-9ba0-a9164a42c735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d56871-0883-4f9f-9ba0-a9164a42c735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '092a84f2-29e4-4023-b3bc-a54c3a4761bc', 'volume_name': 'volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad301c2-12c6-40da-9bbe-2e4eeb0820eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad301c2-12c6-40da-9bbe-2e4eeb0820eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85d9487-e42c-4e0d-a6f3-cb800c2367d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:48 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Volume 092a84f2-29e4-4023-b3bc-a54c3a4761bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc', 'volume_size': 1}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:48 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.info" returned: 0 in 0.322s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:48 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.info is being set with open permissions: ugo+rw
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:48 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.info
Sep 29 18:34:48 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:48 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-43e098dd-3a43-4e0f-995d-b0ff653cbb4a" returned: 0 in 0.381s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Lock "cinder-quobyte-43e098dd-3a43-4e0f-995d-b0ff653cbb4a" released by "delete_volume" :: held 0.936s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (d2dbf2fb-d359-44ed-b059-2926799d9d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61ade95-d997-49f3-a2ca-1e33be645609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61ade95-d997-49f3-a2ca-1e33be645609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701523140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05245e6-3675-4b40-bbe5-965d9f1a5f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:48Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296f474b-e8dd-49e6-a476-c4407a216782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296f474b-e8dd-49e6-a476-c4407a216782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4b8a9b-43e6-442e-8f81-a28c6ba5aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4b8a9b-43e6-442e-8f81-a28c6ba5aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05245e6-3675-4b40-bbe5-965d9f1a5f4c', 'volume_name': 'volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37e3864-c868-4988-95d6-32d25ff57ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37e3864-c868-4988-95d6-32d25ff57ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4143a79a-04a8-4a0f-81af-03fcba8b073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:48 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume a05245e6-3675-4b40-bbe5-965d9f1a5f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c', 'volume_size': 1}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Created reservations ['b91ca1e6-072e-4898-bb56-cdbec1d3fde6', 'e5436a42-53e9-4515-9144-68a5a3b63a60', 'd250c39d-9315-4628-86f0-1ab5a4f80816', 'c05f8c37-19e1-4ddf-9686-d17e3708238b'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:48 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.info" returned: 0 in 0.277s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.415s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-282955017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092a84f2-29e4-4023-b3bc-a54c3a4761bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627fb5ed64224c2d9f2ad34bc0bc1f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:48Z,use_quota=True,user_id='e6fe5011a1b44062bd19f00c6ca21670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Creating volume 092a84f2-29e4-4023-b3bc-a54c3a4761bc {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:48 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:48 devstack sudo[107483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc 1073741824
Sep 29 18:34:48 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:48 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ac7afa73-7826-43b7-b900-c3a25f786e53 tempest-ProjectMemberTests-918657444 None] Create snapshot completed successfully
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:48 devstack sudo[107485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:48 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:48 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.263s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:48 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Deleted volume successfully.
Sep 29 18:34:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-12a70ac1-3fc4-48f5-b416-db37f3ade11a tempest-ProjectReaderTests-1872108792 None] Lock "cinder-43e098dd-3a43-4e0f-995d-b0ff653cbb4a-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:49 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc 1073741824" returned: 0 in 0.458s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:49 devstack sudo[107491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc
Sep 29 18:34:49 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:49 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc" returned: 0 in 0.237s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.799s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701523140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05245e6-3675-4b40-bbe5-965d9f1a5f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:48Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Creating volume a05245e6-3675-4b40-bbe5-965d9f1a5f4c {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:49 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85d9487-e42c-4e0d-a6f3-cb800c2367d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:49 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c 1073741824
Sep 29 18:34:49 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ea2eeb-725c-4d6f-bcb8-c3b75e5d4f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:49 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Volume volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc (092a84f2-29e4-4023-b3bc-a54c3a4761bc): created successfully
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ea2eeb-725c-4d6f-bcb8-c3b75e5d4f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Flow 'volume_create_manager' (48fd7aee-b55e-496f-ace6-79739e316ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:49 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3ea511c3-3e9e-4ce5-ad4e-1fb5fa91347e tempest-VolumeDependencyTests-542348563 None] Created volume successfully.
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-1ab7cf32-2e02-4e58-b77b-50c21e5dba72-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Lock "cinder-1ab7cf32-2e02-4e58-b77b-50c21e5dba72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-b88158dc-7ffa-4eeb-9d97-b22b71647217" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b88158dc-7ffa-4eeb-9d97-b22b71647217" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-1ab7cf32-2e02-4e58-b77b-50c21e5dba72" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-1ab7cf32-2e02-4e58-b77b-50c21e5dba72" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Deleting offline snapshot 1ab7cf32-2e02-4e58-b77b-50c21e5dba72 of volume b88158dc-7ffa-4eeb-9d97-b22b71647217 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] snapshot_file for this snap is: volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3bcb99-f7ca-4fdf-9b2f-3e437ab1e2ee]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:49 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72
Sep 29 18:34:49 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:49 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c 1073741824" returned: 0 in 0.484s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:49 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c
Sep 29 18:34:49 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:50 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72" returned: 0 in 0.456s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b88158dc-7ffa-4eeb-9d97-b22b71647217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e848f3-41ad-499d-b4e2-2aaffb0bdf23]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:50 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Flow 'volume_create_manager' (9df99f89-5734-4d6d-8d99-af869e7963b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15bba51-a133-4ffc-99ad-7f1a4ffdb0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c" returned: 0 in 0.355s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4143a79a-04a8-4a0f-81af-03fcba8b073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c73da3-6bcf-44ca-8183-ef6e4e4e956a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15bba51-a133-4ffc-99ad-7f1a4ffdb0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1238974347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5806eb6a-ac7f-4e94-8887-1a4f8001d656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3778b8376f34a1181f544e48746d29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:50Z,use_quota=True,user_id='d1f5c67a3ee14da4b9cc718c82a7d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eef8dbc-d590-4079-abe1-06805d5e1486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:50 devstack sudo[107507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eef8dbc-d590-4079-abe1-06805d5e1486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:50 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e582eed-c7d2-4593-8f74-07e7deef7a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e582eed-c7d2-4593-8f74-07e7deef7a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5806eb6a-ac7f-4e94-8887-1a4f8001d656', 'volume_name': 'volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa5c9e7-43d1-4732-b642-aa351ab9a995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa5c9e7-43d1-4732-b642-aa351ab9a995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5622db0-b489-4ebd-b800-f9658a6a2689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:50 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Volume 5806eb6a-ac7f-4e94-8887-1a4f8001d656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656', 'volume_size': 1}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1238974347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5806eb6a-ac7f-4e94-8887-1a4f8001d656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3778b8376f34a1181f544e48746d29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:50Z,use_quota=True,user_id='d1f5c67a3ee14da4b9cc718c82a7d74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Creating volume 5806eb6a-ac7f-4e94-8887-1a4f8001d656 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:50 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:50 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c (a05245e6-3675-4b40-bbe5-965d9f1a5f4c): created successfully
Sep 29 18:34:50 devstack sudo[107510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656 1073741824
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c73da3-6bcf-44ca-8183-ef6e4e4e956a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:50 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (d2dbf2fb-d359-44ed-b059-2926799d9d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:50 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-9ec45d3a-ef3c-4682-8e7a-1a113d40e026 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created volume successfully.
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:50 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217" returned: 0 in 0.539s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:50 devstack sudo[107518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72
Sep 29 18:34:50 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:50 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656 1073741824" returned: 0 in 0.545s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:50 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656
Sep 29 18:34:50 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:50 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72" returned: 0 in 0.381s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:50 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72
Sep 29 18:34:50 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:51 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656" returned: 0 in 0.277s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.787s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5622db0-b489-4ebd-b800-f9658a6a2689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dda709-7881-49f6-b3ca-065c7efbb942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] Creating offline snapshot 73fd08a0-847d-4c30-8301-cad33dc5eecc of volume 092a84f2-29e4-4023-b3bc-a54c3a4761bc {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:34:51 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Volume volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656 (5806eb6a-ac7f-4e94-8887-1a4f8001d656): created successfully
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dda709-7881-49f6-b3ca-065c7efbb942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Flow 'volume_create_manager' (9df99f89-5734-4d6d-8d99-af869e7963b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c585a3-0844-4a7b-8d5c-fe10bf78cf3d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:51 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5c45906d-3623-4f87-8442-e2ea3221fed1 tempest-ProjectReaderTests-1872108792 None] Created volume successfully.
Sep 29 18:34:51 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217.1ab7cf32-2e02-4e58-b77b-50c21e5dba72" returned: 0 in 0.270s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-1ab7cf32-2e02-4e58-b77b-50c21e5dba72" released by "_delete_snapshot" :: held 1.772s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b88158dc-7ffa-4eeb-9d97-b22b71647217" released by "delete_snapshot" :: held 1.802s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:51 devstack sudo[107529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc
Sep 29 18:34:51 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Created reservations ['151abf17-5dde-40cd-86a7-83078ed6c3f2', '268dbc0c-cc7a-4357-a483-ba296a2430a2', 'ff50fecf-9408-4761-a970-c53afd3cfaee', '991c4ecc-3fdb-4095-bfbd-ec990c86524a'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:51 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Delete snapshot completed successfully.
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d3b3a988-2f6e-4ddf-9768-5bdaeffad676 tempest-ProjectMemberTests-918657444 None] Lock "cinder-1ab7cf32-2e02-4e58-b77b-50c21e5dba72-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:51 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc" returned: 0 in 0.416s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:51 devstack sudo[107535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc 1G
Sep 29 18:34:51 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-b88158dc-7ffa-4eeb-9d97-b22b71647217-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Lock "cinder-b88158dc-7ffa-4eeb-9d97-b22b71647217-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-b88158dc-7ffa-4eeb-9d97-b22b71647217" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b88158dc-7ffa-4eeb-9d97-b22b71647217" acquired by "delete_volume" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9917b3f-321a-4261-aa3d-b2c24b2529ac]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:51 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217
Sep 29 18:34:51 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:52 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc 1G" returned: 0 in 0.405s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:52 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc
Sep 29 18:34:52 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:52 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217" returned: 0 in 0.392s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Acquiring lock "cinder-5806eb6a-ac7f-4e94-8887-1a4f8001d656-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:52 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217
Sep 29 18:34:52 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Lock "cinder-5806eb6a-ac7f-4e94-8887-1a4f8001d656-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Acquiring lock "cinder-quobyte-5806eb6a-ac7f-4e94-8887-1a4f8001d656" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Lock "cinder-quobyte-5806eb6a-ac7f-4e94-8887-1a4f8001d656" acquired by "delete_volume" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8f70f7-4410-4d2f-9b36-d63a6700d290]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:52 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc" returned: 0 in 0.340s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:52 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc is being set with open permissions: ugo+rw
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:52 devstack sudo[107554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc
Sep 29 18:34:52 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:52 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656
Sep 29 18:34:52 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:52 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b88158dc-7ffa-4eeb-9d97-b22b71647217" returned: 0 in 0.307s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b88158dc-7ffa-4eeb-9d97-b22b71647217" released by "delete_volume" :: held 0.769s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Created reservations ['8f084c7e-eb38-4e66-b033-a502efa2ef47', '729471ed-eae6-40ce-aefe-59433c360880', '829708b0-065e-4f03-ada9-a5a19b9c0d36', 'a0285b41-ae05-4538-8352-205b7871f17b'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:52 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc" returned: 0 in 0.305s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:52 devstack sudo[107559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:52 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:52 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.info
Sep 29 18:34:52 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:52 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656" returned: 0 in 0.459s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:52 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656
Sep 29 18:34:52 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:52 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.315s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:52 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Deleted volume successfully.
Sep 29 18:34:52 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.info" returned: 0 in 0.274s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:52 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.info is being set with open permissions: ugo+rw
Sep 29 18:34:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-df956192-077d-40c6-9e8f-391d144b6113 tempest-ProjectMemberTests-918657444 None] Lock "cinder-b88158dc-7ffa-4eeb-9d97-b22b71647217-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:53 devstack sudo[107571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.info
Sep 29 18:34:53 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:53 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5806eb6a-ac7f-4e94-8887-1a4f8001d656" returned: 0 in 0.316s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Lock "cinder-quobyte-5806eb6a-ac7f-4e94-8887-1a4f8001d656" released by "delete_volume" :: held 0.838s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Created reservations ['3148c3ae-b945-4943-ac2c-f4d6a11042d1', 'b2c7ae9d-761a-430e-94a6-f9d538704202', '8a49d887-6cea-45c3-bb95-5eb323734359', 'eb3f7958-abbe-401f-b17e-0e86c6206e14'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:53 devstack sudo[107576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:53 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:53 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.info" returned: 0 in 0.312s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.683s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Creating offline snapshot 4cd4a94b-8208-42dd-abd2-d05a220a9e1c of volume a05245e6-3675-4b40-bbe5-965d9f1a5f4c {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:34:53 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-da3c5672-8df5-4fc6-a798-899990b2dd30 tempest-VolumeDependencyTests-542348563 None] Create snapshot completed successfully
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (dabf78be-f150-4b96-a842-49dae1e7e789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac07186-9dab-4437-bc41-4e3e67d56935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf88726d-ddbc-4693-9e1b-fc39de1be636]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac07186-9dab-4437-bc41-4e3e67d56935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-900994536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f817a3-a6b4-4189-baf2-ba03fbd423dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:53Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09155454-3c65-4b94-ba78-2cb8b3bf4ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09155454-3c65-4b94-ba78-2cb8b3bf4ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2414d62c-1563-4819-9c0e-d981478de98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2414d62c-1563-4819-9c0e-d981478de98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f817a3-a6b4-4189-baf2-ba03fbd423dd', 'volume_name': 'volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621d8cd2-3c92-419d-985a-3a605337a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621d8cd2-3c92-419d-985a-3a605337a875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22fccbb-37e0-4714-81e4-8f0e55db3f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:53 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Volume 92f817a3-a6b4-4189-baf2-ba03fbd423dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd', 'volume_size': 1}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:53 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.287s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:53 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Deleted volume successfully.
Sep 29 18:34:53 devstack sudo[107578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c
Sep 29 18:34:53 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-d8b2c103-3fa3-42a6-bc3b-1fa0c092344f tempest-ProjectReaderTests-1872108792 None] Lock "cinder-5806eb6a-ac7f-4e94-8887-1a4f8001d656-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:34:53 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c" returned: 0 in 0.424s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:53 devstack sudo[107584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c 1G
Sep 29 18:34:53 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:54 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c 1G" returned: 0 in 0.449s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:54 devstack sudo[107590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c
Sep 29 18:34:54 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:54 devstack sudo[107592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:34:54 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:54 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c" returned: 0 in 0.372s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:54 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c is being set with open permissions: ugo+rw
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:54 devstack sudo[107599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c
Sep 29 18:34:54 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:54 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.308s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:34:54 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c" returned: 0 in 0.299s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:55 devstack sudo[107602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.info
Sep 29 18:34:55 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Flow 'volume_create_manager' (6e338195-33f0-4cca-b047-607fb1f5b1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e63d36-ecc9-448a-99e3-e23a327ce4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e63d36-ecc9-448a-99e3-e23a327ce4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-220158439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252fa36b-7bc6-41ed-b58c-3b259d980ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627fb5ed64224c2d9f2ad34bc0bc1f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=73fd08a0-847d-4c30-8301-cad33dc5eecc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:55Z,use_quota=True,user_id='e6fe5011a1b44062bd19f00c6ca21670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a15a969-f836-4748-b928-6406e4be7109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a15a969-f836-4748-b928-6406e4be7109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0243f136-bf45-415f-be08-d3acd7012f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0243f136-bf45-415f-be08-d3acd7012f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '252fa36b-7bc6-41ed-b58c-3b259d980ee7', 'volume_name': 'volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7', 'volume_size': 1, 'snapshot_id': '73fd08a0-847d-4c30-8301-cad33dc5eecc'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:55 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b384e7-c455-4a04-a99e-2080aee15f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b384e7-c455-4a04-a99e-2080aee15f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24051bf-6687-4452-a32b-fa52b733a03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:55 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Volume 252fa36b-7bc6-41ed-b58c-3b259d980ee7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7', 'volume_size': 1, 'snapshot_id': '73fd08a0-847d-4c30-8301-cad33dc5eecc'}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.info" returned: 0 in 0.362s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:55 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.info is being set with open permissions: ugo+rw
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:55 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.info
Sep 29 18:34:55 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:55 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.info" returned: 0 in 0.276s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.194s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-900994536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f817a3-a6b4-4189-baf2-ba03fbd423dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:53Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Creating volume 92f817a3-a6b4-4189-baf2-ba03fbd423dd {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:55 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:34:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:55 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd 1073741824
Sep 29 18:34:55 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:55 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-63af1c0c-6652-485b-b883-4023a7df72b9 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Create snapshot completed successfully
Sep 29 18:34:56 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd 1073741824" returned: 0 in 0.610s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:56 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd
Sep 29 18:34:56 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (c08fd74b-3d79-4dcc-befd-a02a877f4cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770090fe-cf6c-4828-857a-f6da323ea5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770090fe-cf6c-4828-857a-f6da323ea5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1807975395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54017287-861f-4e2c-adbf-3eb3fb4c1e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:56Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a087b35-71c1-44cd-aba4-89173d2e82a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a087b35-71c1-44cd-aba4-89173d2e82a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0df6a4f-6c0b-475d-aa54-b531f04095e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0df6a4f-6c0b-475d-aa54-b531f04095e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54017287-861f-4e2c-adbf-3eb3fb4c1e93', 'volume_name': 'volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024c6680-2c67-401f-9d6e-248aa229e0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024c6680-2c67-401f-9d6e-248aa229e0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4c44bf-9271-47fc-a98f-789bea93ba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:56 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume 54017287-861f-4e2c-adbf-3eb3fb4c1e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93', 'volume_size': 1}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (faaf2814-3ad7-4df3-ae9a-5ff78703a525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:56 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a306bb-489d-47c9-a0ed-cfe972112ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd" returned: 0 in 0.551s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.507s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Acquiring lock "cinder-quobyte-73fd08a0-847d-4c30-8301-cad33dc5eecc-252fa36b-7bc6-41ed-b58c-3b259d980ee7" by "_create_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a306bb-489d-47c9-a0ed-cfe972112ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1615016437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077d23b4-b5d2-4701-9ee0-ae7cd0af4e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:57Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9983792d-e770-4729-911a-856e6053cc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9983792d-e770-4729-911a-856e6053cc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ded4174-67c2-4ec3-a870-e4dcf58ca00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ded4174-67c2-4ec3-a870-e4dcf58ca00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '077d23b4-b5d2-4701-9ee0-ae7cd0af4e70', 'volume_name': 'volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e85ea8-6743-4d34-b893-12cfae98c3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e85ea8-6743-4d34-b893-12cfae98c3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d41bf25-921c-4a83-ba2f-96aa8571923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:56 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume 077d23b4-b5d2-4701-9ee0-ae7cd0af4e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70', 'volume_size': 1}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22fccbb-37e0-4714-81e4-8f0e55db3f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5114a1-49d0-473b-949b-b57b8b8177d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-73fd08a0-847d-4c30-8301-cad33dc5eecc-252fa36b-7bc6-41ed-b58c-3b259d980ee7" acquired by "_create_volume_from_snapshot" :: waited 0.067s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Creating volume 252fa36b-7bc6-41ed-b58c-3b259d980ee7 from snapshot 73fd08a0-847d-4c30-8301-cad33dc5eecc {{(pid=86821) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Acquiring lock "cinder-quobyte-252fa36b-7bc6-41ed-b58c-3b259d980ee7" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-252fa36b-7bc6-41ed-b58c-3b259d980ee7" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] snapshot: 73fd08a0-847d-4c30-8301-cad33dc5eecc, volume: 252fa36b-7bc6-41ed-b58c-3b259d980ee7,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:34:57 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Volume volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd (92f817a3-a6b4-4189-baf2-ba03fbd423dd): created successfully
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5114a1-49d0-473b-949b-b57b8b8177d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (dabf78be-f150-4b96-a842-49dae1e7e789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:34:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-40d92c43-3cb4-4e46-ae68-4b1b8b8c24e5 tempest-ProjectMemberTests-918657444 None] Created volume successfully.
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca576f14-a466-45fa-ab53-b330a8af0670]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:57 devstack sudo[107617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc
Sep 29 18:34:57 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (2fd15be9-a0bd-4ddc-944e-963607385825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef328731-0fbb-4769-90a6-0d86c35b99d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef328731-0fbb-4769-90a6-0d86c35b99d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1055942734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40009064-383c-49d8-afb6-e0acd479cfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:57Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a2f09c-2001-4734-bd97-42aed7a44eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a2f09c-2001-4734-bd97-42aed7a44eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bcbac7-2681-492e-b01a-4c145b137c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bcbac7-2681-492e-b01a-4c145b137c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40009064-383c-49d8-afb6-e0acd479cfc1', 'volume_name': 'volume-40009064-383c-49d8-afb6-e0acd479cfc1', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb2e66e-637e-40ac-8c6c-7fe9c7e7dc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb2e66e-637e-40ac-8c6c-7fe9c7e7dc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:57 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c490ba-e857-4c25-ae86-bc5f41a67e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:57 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume 40009064-383c-49d8-afb6-e0acd479cfc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40009064-383c-49d8-afb6-e0acd479cfc1', 'volume_size': 1}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc" returned: 0 in 0.688s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cea8574-afa3-4adc-a368-896414a422f2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:34:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:57 devstack sudo[107622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc
Sep 29 18:34:57 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (fbd287ac-2068-4bcd-ae05-a7fa415c03a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb3b0c9-750a-43b7-b3c5-bb31ae3d2cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb3b0c9-750a-43b7-b3c5-bb31ae3d2cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1638273789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df37f3e0-e0b2-401c-a253-04488aebd188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:58Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe53772f-ea9c-495f-a202-3e765df3385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe53772f-ea9c-495f-a202-3e765df3385a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18dbd7a2-30ad-4233-9a47-51e50ccf1e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18dbd7a2-30ad-4233-9a47-51e50ccf1e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df37f3e0-e0b2-401c-a253-04488aebd188', 'volume_name': 'volume-df37f3e0-e0b2-401c-a253-04488aebd188', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48cfa312-8764-4404-be19-c71d8fb7a419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48cfa312-8764-4404-be19-c71d8fb7a419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede19b9b-1bcc-42d1-b7bd-ad837dfe9190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:58 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume df37f3e0-e0b2-401c-a253-04488aebd188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df37f3e0-e0b2-401c-a253-04488aebd188', 'volume_size': 1}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:34:58 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc" returned: 0 in 0.520s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7 not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:34:58 devstack sudo[107627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7
Sep 29 18:34:58 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (70a2880d-5dc1-4397-a584-b4ebc19b416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee5176d-5812-449e-a1b4-8e52e1068d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee5176d-5812-449e-a1b4-8e52e1068d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396310678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb01d1c9-b198-4439-95e9-3bbe9f797941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:59Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bbc1f5-7908-4a19-9002-20828799136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bbc1f5-7908-4a19-9002-20828799136e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20c76e4-ca26-42c1-b5a2-5fd2af6cfe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20c76e4-ca26-42c1-b5a2-5fd2af6cfe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb01d1c9-b198-4439-95e9-3bbe9f797941', 'volume_name': 'volume-fb01d1c9-b198-4439-95e9-3bbe9f797941', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade9d9d6-779d-4923-9f19-0b26463439d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade9d9d6-779d-4923-9f19-0b26463439d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3c6e2b-65ac-4b25-b212-b1f53a070c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:34:58 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume fb01d1c9-b198-4439-95e9-3bbe9f797941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb01d1c9-b198-4439-95e9-3bbe9f797941', 'volume_size': 1}
Sep 29 18:34:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:06 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7" returned: 0 in 7.717s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc, size 1024.00 MB, duration 7.72 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7 {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:35:06 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Converted 1024.00 MB image at 132.68 MB/s
Sep 29 18:35:06 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7 is being set with open permissions: ugo+rw
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:06 devstack sudo[107646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7
Sep 29 18:35:06 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:06 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7" returned: 0 in 0.268s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-252fa36b-7bc6-41ed-b58c-3b259d980ee7" released by "_copy_volume_from_snapshot" :: held 9.312s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-73fd08a0-847d-4c30-8301-cad33dc5eecc-252fa36b-7bc6-41ed-b58c-3b259d980ee7" released by "_create_volume_from_snapshot" :: held 9.397s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.466s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.752s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1807975395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54017287-861f-4e2c-adbf-3eb3fb4c1e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:56Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Creating volume 54017287-861f-4e2c-adbf-3eb3fb4c1e93 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:06 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:06 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93 1073741824
Sep 29 18:35:06 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24051bf-6687-4452-a32b-fa52b733a03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7', 'volume_size': 1, 'snapshot_id': '73fd08a0-847d-4c30-8301-cad33dc5eecc'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a815723e-1055-49e8-9d5b-a3390a7b5837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:06 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Volume volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7 (252fa36b-7bc6-41ed-b58c-3b259d980ee7): created successfully
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a815723e-1055-49e8-9d5b-a3390a7b5837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Flow 'volume_create_manager' (6e338195-33f0-4cca-b047-607fb1f5b1c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:06 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-34172ae1-69ac-4d94-8385-8e7ac77986aa tempest-VolumeDependencyTests-542348563 None] Created volume successfully.
Sep 29 18:35:06 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93 1073741824" returned: 0 in 0.558s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:07 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93
Sep 29 18:35:07 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:07 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93" returned: 0 in 0.290s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.324s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1615016437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077d23b4-b5d2-4701-9ee0-ae7cd0af4e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:57Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Creating volume 077d23b4-b5d2-4701-9ee0-ae7cd0af4e70 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:07 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4c44bf-9271-47fc-a98f-789bea93ba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:07 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70 1073741824
Sep 29 18:35:07 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1333824-4d93-45b7-afa7-6644dd564994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:07 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93 (54017287-861f-4e2c-adbf-3eb3fb4c1e93): created successfully
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1333824-4d93-45b7-afa7-6644dd564994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (c08fd74b-3d79-4dcc-befd-a02a877f4cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:07 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e7d82283-49b9-48ee-b401-9940955cdb83 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created volume successfully.
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Acquiring lock "cinder-73fd08a0-847d-4c30-8301-cad33dc5eecc-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Lock "cinder-73fd08a0-847d-4c30-8301-cad33dc5eecc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Acquiring lock "cinder-quobyte-092a84f2-29e4-4023-b3bc-a54c3a4761bc" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-092a84f2-29e4-4023-b3bc-a54c3a4761bc" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Acquiring lock "cinder-quobyte-73fd08a0-847d-4c30-8301-cad33dc5eecc" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-73fd08a0-847d-4c30-8301-cad33dc5eecc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Deleting offline snapshot 73fd08a0-847d-4c30-8301-cad33dc5eecc of volume 092a84f2-29e4-4023-b3bc-a54c3a4761bc {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] snapshot_file for this snap is: volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3758c12d-e526-421a-8060-16b220dbc63c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:07 devstack sudo[107662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc
Sep 29 18:35:07 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:07 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70 1073741824" returned: 0 in 0.679s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:08 devstack sudo[107670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70
Sep 29 18:35:08 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:08 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc" returned: 0 in 0.508s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[19920fa9-262d-4872-9ea5-c4e254f0b1b8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:08 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70" returned: 0 in 0.364s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.622s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1055942734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40009064-383c-49d8-afb6-e0acd479cfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:57Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Creating volume 40009064-383c-49d8-afb6-e0acd479cfc1 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:08 devstack sudo[107673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc
Sep 29 18:35:08 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:08 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:08 devstack sudo[107676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1 1073741824
Sep 29 18:35:08 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d41bf25-921c-4a83-ba2f-96aa8571923d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f213991d-82fd-4234-b50b-f91697c77136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:08 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70 (077d23b4-b5d2-4701-9ee0-ae7cd0af4e70): created successfully
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f213991d-82fd-4234-b50b-f91697c77136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:08 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (faaf2814-3ad7-4df3-ae9a-5ff78703a525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:08 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6b8c0496-dc60-4f44-9c6d-6665f7d85573 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created volume successfully.
Sep 29 18:35:09 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc" returned: 0 in 0.849s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:09 devstack sudo[107685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc
Sep 29 18:35:09 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:09 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1 1073741824" returned: 0 in 0.728s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:09 devstack sudo[107687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1
Sep 29 18:35:09 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:09 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc" returned: 0 in 0.454s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:09 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1" returned: 0 in 0.351s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.548s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:09 devstack sudo[107694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc
Sep 29 18:35:09 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c490ba-e857-4c25-ae86-bc5f41a67e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40009064-383c-49d8-afb6-e0acd479cfc1', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb3fc59-8ea5-46bd-a9fc-f93bd3c850ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] Creating offline snapshot 3542defc-85a8-4cbb-8f05-6ecea649fe12 of volume 92f817a3-a6b4-4189-baf2-ba03fbd423dd {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:35:09 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume volume-40009064-383c-49d8-afb6-e0acd479cfc1 (40009064-383c-49d8-afb6-e0acd479cfc1): created successfully
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb3fc59-8ea5-46bd-a9fc-f93bd3c850ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (2fd15be9-a0bd-4ddc-944e-963607385825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[839de236-a921-46ee-b89d-4249f51138f6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:09 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-d8b8672d-e13f-48bc-9b1e-cbf0c98fcb21 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created volume successfully.
Sep 29 18:35:09 devstack sudo[107696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd
Sep 29 18:35:09 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:09 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc.73fd08a0-847d-4c30-8301-cad33dc5eecc" returned: 0 in 0.356s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-73fd08a0-847d-4c30-8301-cad33dc5eecc" released by "_delete_snapshot" :: held 2.335s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-092a84f2-29e4-4023-b3bc-a54c3a4761bc" released by "delete_snapshot" :: held 2.362s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Created reservations ['34f187e0-4a6a-4b64-aef4-676024aeb200', 'dd4a7cd7-398a-4090-9a4a-c3be4f348244', '2e8a4ab8-2926-4c87-983d-3d07640e56be', 'f2c46064-c820-4d1a-a008-06b88a03cfdd'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:10 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Delete snapshot completed successfully.
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-46554cff-0d2d-4762-b31c-b83cbdad8b18 tempest-VolumeDependencyTests-542348563 None] Lock "cinder-73fd08a0-847d-4c30-8301-cad33dc5eecc-delete_snapshot" released by "delete_snapshot" :: held 2.580s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:10 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd" returned: 0 in 0.515s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:10 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12 1G
Sep 29 18:35:10 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:10 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12 1G" returned: 0 in 0.432s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:10 devstack sudo[107709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12
Sep 29 18:35:10 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Acquiring lock "cinder-092a84f2-29e4-4023-b3bc-a54c3a4761bc-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Lock "cinder-092a84f2-29e4-4023-b3bc-a54c3a4761bc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Acquiring lock "cinder-quobyte-092a84f2-29e4-4023-b3bc-a54c3a4761bc" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-092a84f2-29e4-4023-b3bc-a54c3a4761bc" acquired by "delete_volume" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:10 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12" returned: 0 in 0.351s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:10 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12 is being set with open permissions: ugo+rw
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc6f8bd-ff88-4c99-8ec6-d0d456a9b9ef]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:10 devstack sudo[107715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12
Sep 29 18:35:10 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:11 devstack sudo[107716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc
Sep 29 18:35:11 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:11 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12" returned: 0 in 0.273s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:11 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.info
Sep 29 18:35:11 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:11 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc" returned: 0 in 0.516s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:11 devstack sudo[107726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc
Sep 29 18:35:11 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:11 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.info" returned: 0 in 0.306s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:11 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.info is being set with open permissions: ugo+rw
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:11 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.info
Sep 29 18:35:11 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:11 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-092a84f2-29e4-4023-b3bc-a54c3a4761bc" returned: 0 in 0.272s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-092a84f2-29e4-4023-b3bc-a54c3a4761bc" released by "delete_volume" :: held 0.878s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:11 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Created reservations ['8908e770-17cc-46cf-b477-bf0a5bc2e69d', 'c8d8b7bc-bc62-4f48-b29a-e4d32f17047b', '0c810f0f-b916-4e6a-b7a4-cc3ee55773b8', '9a34f0f8-fcc4-486d-a2fc-2ceb3ac18aae'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.info" returned: 0 in 0.270s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.288s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.650s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1638273789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df37f3e0-e0b2-401c-a253-04488aebd188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:58Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Creating volume df37f3e0-e0b2-401c-a253-04488aebd188 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:11 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:11 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188 1073741824
Sep 29 18:35:11 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:11 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-4e276769-972a-48d3-b45e-1b28964dd279 tempest-ProjectMemberTests-918657444 None] Create snapshot completed successfully
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:12 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:12 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Acquiring lock "cinder-252fa36b-7bc6-41ed-b58c-3b259d980ee7-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Lock "cinder-252fa36b-7bc6-41ed-b58c-3b259d980ee7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Acquiring lock "cinder-quobyte-252fa36b-7bc6-41ed-b58c-3b259d980ee7" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-252fa36b-7bc6-41ed-b58c-3b259d980ee7" acquired by "delete_volume" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f51f86-99b3-43b9-a5dd-f3109a0fd779]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:12 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.358s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:12 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Deleted volume successfully.
Sep 29 18:35:12 devstack sudo[107740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7
Sep 29 18:35:12 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8728deb3-808b-42cc-99cd-51b371535b08 tempest-VolumeDependencyTests-542348563 None] Lock "cinder-092a84f2-29e4-4023-b3bc-a54c3a4761bc-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:12 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188 1073741824" returned: 0 in 0.591s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:12 devstack sudo[107745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188
Sep 29 18:35:12 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:12 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7" returned: 0 in 0.459s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:12 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-3542defc-85a8-4cbb-8f05-6ecea649fe12-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:12 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Lock "cinder-3542defc-85a8-4cbb-8f05-6ecea649fe12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-92f817a3-a6b4-4189-baf2-ba03fbd423dd" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-92f817a3-a6b4-4189-baf2-ba03fbd423dd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-3542defc-85a8-4cbb-8f05-6ecea649fe12" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-3542defc-85a8-4cbb-8f05-6ecea649fe12" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Deleting offline snapshot 3542defc-85a8-4cbb-8f05-6ecea649fe12 of volume 92f817a3-a6b4-4189-baf2-ba03fbd423dd {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] snapshot_file for this snap is: volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2940443-0b91-4cd6-b738-2a10511b2c17]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:12 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188" returned: 0 in 0.375s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.140s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396310678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb01d1c9-b198-4439-95e9-3bbe9f797941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af4ba3cb8a7417c89878cd7f80fcff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:59Z,use_quota=True,user_id='941e2826d0e047f19bb94c12e49cd9cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Creating volume fb01d1c9-b198-4439-95e9-3bbe9f797941 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:12 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede19b9b-1bcc-42d1-b7bd-ad837dfe9190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df37f3e0-e0b2-401c-a253-04488aebd188', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d204a883-fff7-46dc-b57f-98fc06b810bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:12 devstack sudo[107755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941 1073741824
Sep 29 18:35:12 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:12 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume volume-df37f3e0-e0b2-401c-a253-04488aebd188 (df37f3e0-e0b2-401c-a253-04488aebd188): created successfully
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d204a883-fff7-46dc-b57f-98fc06b810bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:12 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (fbd287ac-2068-4bcd-ae05-a7fa415c03a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:12 devstack sudo[107754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12
Sep 29 18:35:12 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:13 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5f32a9b2-dcda-4574-b0c6-51562d41e0fc tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created volume successfully.
Sep 29 18:35:13 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-252fa36b-7bc6-41ed-b58c-3b259d980ee7" returned: 0 in 0.370s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Lock "cinder-quobyte-252fa36b-7bc6-41ed-b58c-3b259d980ee7" released by "delete_volume" :: held 0.879s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Created reservations ['c73e4ee8-6c9f-4cca-a596-da7e1ac91b04', '7ff970ef-b3f0-4dd9-b162-2b53a31b5bd7', 'ce930bec-f5be-4ee6-936c-f68214ec1ef3', 'a0066534-b8c2-4d38-aa31-8a76b90cde05'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:13 devstack sudo[107762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:13 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:13 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12" returned: 0 in 0.515s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc3a602-45d9-4e70-9957-4bb21bc98e18]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:13 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.363s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:13 devstack sudo[107768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd
Sep 29 18:35:13 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:13 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Deleted volume successfully.
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-455cd8ae-7209-4d96-8e3f-928df554245d tempest-VolumeDependencyTests-542348563 None] Lock "cinder-252fa36b-7bc6-41ed-b58c-3b259d980ee7-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:13 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941 1073741824" returned: 0 in 0.762s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:13 devstack sudo[107771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941
Sep 29 18:35:13 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:13 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd" returned: 0 in 0.478s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:13 devstack sudo[107776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12
Sep 29 18:35:13 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:14 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941" returned: 0 in 0.329s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3c6e2b-65ac-4b25-b212-b1f53a070c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb01d1c9-b198-4439-95e9-3bbe9f797941', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a656d38a-386c-486d-8712-b251de2b8f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:14 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Volume volume-fb01d1c9-b198-4439-95e9-3bbe9f797941 (fb01d1c9-b198-4439-95e9-3bbe9f797941): created successfully
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a656d38a-386c-486d-8712-b251de2b8f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Flow 'volume_create_manager' (70a2880d-5dc1-4397-a584-b4ebc19b416f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:14 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0b28fbb1-3b98-4168-a5fb-58fc13657ab2 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created volume successfully.
Sep 29 18:35:14 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12" returned: 0 in 0.408s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:14 devstack sudo[107782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12
Sep 29 18:35:14 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:14 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-fb01d1c9-b198-4439-95e9-3bbe9f797941-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd.3542defc-85a8-4cbb-8f05-6ecea649fe12" returned: 0 in 0.335s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-fb01d1c9-b198-4439-95e9-3bbe9f797941-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-3542defc-85a8-4cbb-8f05-6ecea649fe12" released by "_delete_snapshot" :: held 1.946s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-92f817a3-a6b4-4189-baf2-ba03fbd423dd" released by "delete_snapshot" :: held 1.977s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-quobyte-fb01d1c9-b198-4439-95e9-3bbe9f797941" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-fb01d1c9-b198-4439-95e9-3bbe9f797941" acquired by "delete_volume" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a24d71-0024-44ba-9f79-1d68878d9f33]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Created reservations ['c872edc1-145b-42ce-86f1-cf74cac7a4ee', '8bab7941-56bb-4fa6-9a58-115143e12dd6', 'bd069459-b35c-4a12-b7a4-4ffed8f4a6b1', 'ccffe905-9aeb-4376-b315-5ca67224c115'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:14 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941
Sep 29 18:35:14 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Delete snapshot completed successfully.
Sep 29 18:35:14 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:14 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3369525a-69d6-429f-9950-6461c75f0bfe tempest-ProjectMemberTests-918657444 None] Lock "cinder-3542defc-85a8-4cbb-8f05-6ecea649fe12-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:15 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941" returned: 0 in 0.448s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:15 devstack sudo[107790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941
Sep 29 18:35:15 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:15 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-fb01d1c9-b198-4439-95e9-3bbe9f797941" returned: 0 in 0.288s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-fb01d1c9-b198-4439-95e9-3bbe9f797941" released by "delete_volume" :: held 0.793s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created reservations ['33fab9bc-176c-4841-b8bc-c28fa89c0bd0', 'e19cf3f4-2111-4350-8b63-6ae0127b67ea', '26eb7efb-0857-42f6-b7db-d75539894b46', 'f767129b-865d-4e16-8782-0cc32d3fab4b'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:15 devstack sudo[107793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:15 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-df37f3e0-e0b2-401c-a253-04488aebd188-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-df37f3e0-e0b2-401c-a253-04488aebd188-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-quobyte-df37f3e0-e0b2-401c-a253-04488aebd188" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-df37f3e0-e0b2-401c-a253-04488aebd188" acquired by "delete_volume" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:16 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[35acdec8-33c1-4468-9459-8ee14d15f416]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.464s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-92f817a3-a6b4-4189-baf2-ba03fbd423dd-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:16 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Deleted volume successfully.
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Lock "cinder-92f817a3-a6b4-4189-baf2-ba03fbd423dd-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50088bbd-df5c-44dc-8b11-710f14024aa1 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-fb01d1c9-b198-4439-95e9-3bbe9f797941-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:16 devstack sudo[107796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188
Sep 29 18:35:16 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-92f817a3-a6b4-4189-baf2-ba03fbd423dd" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-92f817a3-a6b4-4189-baf2-ba03fbd423dd" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdc54d3-e43c-4077-8604-7b2a6f4141b8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:16 devstack sudo[107798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd
Sep 29 18:35:16 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:16 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188" returned: 0 in 0.505s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:16 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188
Sep 29 18:35:16 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:16 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd" returned: 0 in 0.470s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:16 devstack sudo[107809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd
Sep 29 18:35:16 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:16 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-df37f3e0-e0b2-401c-a253-04488aebd188" returned: 0 in 0.302s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:16 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-df37f3e0-e0b2-401c-a253-04488aebd188" released by "delete_volume" :: held 0.891s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created reservations ['06ccf547-e913-4df7-a970-c2d230e2a7d0', '8045c7a9-4874-4bc1-a6b1-670b5e1bfe20', '3bc44862-ba75-4c25-8912-7e9a449297c7', '66921c7e-c9ea-4138-8d3f-501405648a8f'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:17 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-92f817a3-a6b4-4189-baf2-ba03fbd423dd" returned: 0 in 0.317s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-92f817a3-a6b4-4189-baf2-ba03fbd423dd" released by "delete_volume" :: held 0.884s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:17 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:17 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Created reservations ['8f5753fe-bba0-410d-847c-4766932c4482', '61e6fc35-f549-435f-ae38-177ede9ff468', '2bff3d8a-983a-438b-8d9b-a147eaf1c558', '030ac7a0-ff6f-4674-9be9-6c22043624a6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:17 devstack sudo[107816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:17 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:17 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.387s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:17 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Deleted volume successfully.
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-ac2abbd2-d403-4d8e-938b-03c1aaf2fc3d tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-df37f3e0-e0b2-401c-a253-04488aebd188-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:17 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.389s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:17 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Deleted volume successfully.
Sep 29 18:35:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0ba6eee6-b0d0-4a8c-bada-48ea9e419fda tempest-ProjectMemberTests-918657444 None] Lock "cinder-92f817a3-a6b4-4189-baf2-ba03fbd423dd-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-40009064-383c-49d8-afb6-e0acd479cfc1-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-40009064-383c-49d8-afb6-e0acd479cfc1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-quobyte-40009064-383c-49d8-afb6-e0acd479cfc1" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-40009064-383c-49d8-afb6-e0acd479cfc1" acquired by "delete_volume" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:18 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ee615d-e1ea-469d-9520-208f3762eca9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:18 devstack sudo[107820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1
Sep 29 18:35:18 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:18 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1" returned: 0 in 0.496s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:19 devstack sudo[107825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1
Sep 29 18:35:19 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (9e922e28-9afb-496e-a42c-c85ace0fb136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6951d1-94e3-4774-bf87-83307c164aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6951d1-94e3-4774-bf87-83307c164aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822069898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ac5df8-5a37-47f5-9873-10483ba4c2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:19Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97eeab4c-5712-4896-9c03-0495f17ad421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97eeab4c-5712-4896-9c03-0495f17ad421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4a2d31-4336-4faf-9988-e2280602a861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4a2d31-4336-4faf-9988-e2280602a861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0ac5df8-5a37-47f5-9873-10483ba4c2c0', 'volume_name': 'volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cacae5-375b-43db-8354-33076d22ae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cacae5-375b-43db-8354-33076d22ae4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73016c1-7661-42a4-8a40-c68014fbe106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:19 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Volume b0ac5df8-5a37-47f5-9873-10483ba4c2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0', 'volume_size': 1}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822069898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ac5df8-5a37-47f5-9873-10483ba4c2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:19Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Creating volume b0ac5df8-5a37-47f5-9873-10483ba4c2c0 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:19 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:19 devstack sudo[107828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 1073741824
Sep 29 18:35:19 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:19 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-40009064-383c-49d8-afb6-e0acd479cfc1" returned: 0 in 0.562s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-40009064-383c-49d8-afb6-e0acd479cfc1" released by "delete_volume" :: held 1.134s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created reservations ['c69fe8a7-d3d1-4da3-923f-e7932b76ce4a', 'baebd711-80d4-4224-8e37-4676de59f93e', '7037a588-2a86-41b2-a838-e5de2582f8e0', 'acf78421-fbb3-4274-a3ae-5e4a0800c23c'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:19 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:19 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:20 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.327s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:20 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Deleted volume successfully.
Sep 29 18:35:20 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 1073741824" returned: 0 in 0.803s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-b31843f8-0357-456f-8782-96655feaf7ce tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-40009064-383c-49d8-afb6-e0acd479cfc1-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:20 devstack sudo[107836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0
Sep 29 18:35:20 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:20 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0" returned: 0 in 0.415s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73016c1-7661-42a4-8a40-c68014fbe106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2b1a53-3f9e-4df0-a168-9a199640e7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:20 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Volume volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 (b0ac5df8-5a37-47f5-9873-10483ba4c2c0): created successfully
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2b1a53-3f9e-4df0-a168-9a199640e7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (9e922e28-9afb-496e-a42c-c85ace0fb136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:20 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-60e7316f-cdcc-448a-ac85-2d6097a82146 tempest-ProjectMemberTests-918657444 None] Created volume successfully.
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-quobyte-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7355e1a-b569-4435-9202-37acc59b9d1c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:21 devstack sudo[107839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70
Sep 29 18:35:21 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:21 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70" returned: 0 in 0.520s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:21 devstack sudo[107845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70
Sep 29 18:35:21 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=208,cinder:UPDATE=282,cinder:DELETE=28,cinder:INSERT=81 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=204,cinder:UPDATE=279,cinder:INSERT=68,cinder:DELETE=24 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] Creating offline snapshot 86cb229f-2a78-446f-970c-b7252fb03590 of volume b0ac5df8-5a37-47f5-9873-10483ba4c2c0 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[729fd22a-b1eb-4fea-bf2c-d5f0bf5c47dc]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:21 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70" returned: 0 in 0.370s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70" released by "delete_volume" :: held 0.935s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:21 devstack sudo[107847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0
Sep 29 18:35:21 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created reservations ['52a3501d-d35b-4cce-a0bb-a4b72413b07c', '5a3ebe4a-f514-41b7-a647-04728a4f35fe', '6ebf5492-1e27-4473-842b-1c2df740f33b', 'a29fb737-a00c-4d88-be60-0fdae1d7eb95'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:22 devstack sudo[107850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:22 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:22 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0" returned: 0 in 0.631s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:22 devstack sudo[107855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590 1G
Sep 29 18:35:22 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:22 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.421s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:22 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:22 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Deleted volume successfully.
Sep 29 18:35:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2977ff95-e2b4-4800-be7c-5768442fc774 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-077d23b4-b5d2-4701-9ee0-ae7cd0af4e70-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:22 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590 1G" returned: 0 in 0.581s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:22 devstack sudo[107862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590
Sep 29 18:35:22 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-54017287-861f-4e2c-adbf-3eb3fb4c1e93-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-54017287-861f-4e2c-adbf-3eb3fb4c1e93-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-quobyte-54017287-861f-4e2c-adbf-3eb3fb4c1e93" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-54017287-861f-4e2c-adbf-3eb3fb4c1e93" acquired by "delete_volume" :: waited 0.052s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4617b4f8-07e3-4df1-992c-44f21bff160b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:23 devstack sudo[107866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93
Sep 29 18:35:23 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:23 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590" returned: 0 in 0.542s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:23 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590 is being set with open permissions: ugo+rw
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:23 devstack sudo[107870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590
Sep 29 18:35:23 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:23 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93" returned: 0 in 0.486s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:35:23 devstack sudo[107875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93
Sep 29 18:35:23 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Flow 'volume_create_manager' (78df9fb3-8663-4370-887d-0c66223884ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1cfed5e-6ceb-47cd-a553-d778d552ae1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1cfed5e-6ceb-47cd-a553-d778d552ae1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1373957038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6b6531-66e7-476a-8f32-62890c286376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc872fa188947c4bffe65b5b54c7885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:24Z,use_quota=True,user_id='360cb9c1dc9047a4a4ceee6e9db22605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:23 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b747f640-3f03-4f5f-8736-4cc08f8f0faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b747f640-3f03-4f5f-8736-4cc08f8f0faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9db58d-17bc-4430-b250-424a5efd53e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9db58d-17bc-4430-b250-424a5efd53e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6b6531-66e7-476a-8f32-62890c286376', 'volume_name': 'volume-7c6b6531-66e7-476a-8f32-62890c286376', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9098149a-5ec9-4678-89f7-21e52d1828fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9098149a-5ec9-4678-89f7-21e52d1828fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b42b80-fdfd-4305-9bd0-6a0954b8d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:23 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Volume 7c6b6531-66e7-476a-8f32-62890c286376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6b6531-66e7-476a-8f32-62890c286376', 'volume_size': 1}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590" returned: 0 in 0.406s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:23 devstack sudo[107878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.info
Sep 29 18:35:23 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:23 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-54017287-861f-4e2c-adbf-3eb3fb4c1e93" returned: 0 in 0.261s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-54017287-861f-4e2c-adbf-3eb3fb4c1e93" released by "delete_volume" :: held 0.811s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created reservations ['abaff379-d440-4502-a37c-d2be4cc5eab5', '40ae19eb-6102-4435-8985-0f346ed390f1', '062f01a7-bcd9-4fe5-97ac-5e8715b0228d', 'f5be161f-03af-46d3-812a-d51010ec5de9'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:24 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.info" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:24 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.info is being set with open permissions: ugo+rw
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:24 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:24 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:24 devstack sudo[107883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.info
Sep 29 18:35:24 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-4cd4a94b-8208-42dd-abd2-d05a220a9e1c-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-4cd4a94b-8208-42dd-abd2-d05a220a9e1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-quobyte-a05245e6-3675-4b40-bbe5-965d9f1a5f4c" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-a05245e6-3675-4b40-bbe5-965d9f1a5f4c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-quobyte-4cd4a94b-8208-42dd-abd2-d05a220a9e1c" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-4cd4a94b-8208-42dd-abd2-d05a220a9e1c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Deleting offline snapshot 4cd4a94b-8208-42dd-abd2-d05a220a9e1c of volume a05245e6-3675-4b40-bbe5-965d9f1a5f4c {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] snapshot_file for this snap is: volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb62a4e3-4932-4b4a-893d-ad6060f80f3e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:24 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.info" returned: 0 in 0.331s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:24 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.915s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1373957038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6b6531-66e7-476a-8f32-62890c286376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc872fa188947c4bffe65b5b54c7885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:24Z,use_quota=True,user_id='360cb9c1dc9047a4a4ceee6e9db22605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Creating volume 7c6b6531-66e7-476a-8f32-62890c286376 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:24 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.419s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Deleted volume successfully.
Sep 29 18:35:24 devstack sudo[107889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 1073741824
Sep 29 18:35:24 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-030737ab-26cc-49b1-a43b-f9d875501f38 tempest-ProjectMemberTests-918657444 None] Create snapshot completed successfully
Sep 29 18:35:24 devstack sudo[107888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-78f3c93f-e25a-4e05-9bdd-e8aa3d936fb3 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-54017287-861f-4e2c-adbf-3eb3fb4c1e93-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:24 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-86cb229f-2a78-446f-970c-b7252fb03590-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Lock "cinder-86cb229f-2a78-446f-970c-b7252fb03590-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-b0ac5df8-5a37-47f5-9873-10483ba4c2c0" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b0ac5df8-5a37-47f5-9873-10483ba4c2c0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-86cb229f-2a78-446f-970c-b7252fb03590" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-86cb229f-2a78-446f-970c-b7252fb03590" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Deleting offline snapshot 86cb229f-2a78-446f-970c-b7252fb03590 of volume b0ac5df8-5a37-47f5-9873-10483ba4c2c0 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] snapshot_file for this snap is: volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d903757d-e7b6-4413-bd2f-74840d6c7ef3]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:24 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c" returned: 0 in 0.496s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:24 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e55ffde-ec16-467c-be0f-c52eac082c3f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:25 devstack sudo[107898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590
Sep 29 18:35:25 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:25 devstack sudo[107899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c
Sep 29 18:35:25 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:25 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 1073741824" returned: 0 in 0.606s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:25 devstack sudo[107903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376
Sep 29 18:35:25 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:25 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590" returned: 0 in 0.467s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca60f7-fa62-4e77-ad6e-1414173ed7b2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:25 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c" returned: 0 in 0.440s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:25 devstack sudo[107913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c
Sep 29 18:35:25 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:25 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376" returned: 0 in 0.351s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:25 devstack sudo[107912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0
Sep 29 18:35:25 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b42b80-fdfd-4305-9bd0-6a0954b8d00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6b6531-66e7-476a-8f32-62890c286376', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c650100-b12d-4bbf-95de-360d2a20c7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:25 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Volume volume-7c6b6531-66e7-476a-8f32-62890c286376 (7c6b6531-66e7-476a-8f32-62890c286376): created successfully
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c650100-b12d-4bbf-95de-360d2a20c7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Flow 'volume_create_manager' (78df9fb3-8663-4370-887d-0c66223884ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:25 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-adae4409-f0e6-4177-a196-46c4bc753376 tempest-SnapshotDependencyTests-929259875 None] Created volume successfully.
Sep 29 18:35:25 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c" returned: 0 in 0.453s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:25 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0" returned: 0 in 0.499s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:25 devstack sudo[107923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c
Sep 29 18:35:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:25 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:25 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590
Sep 29 18:35:25 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Flow 'volume_create_manager' (e9978a33-e1af-4455-b36f-0c31a8b8bcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f327e011-28c0-4515-b173-18c18cfdce63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f327e011-28c0-4515-b173-18c18cfdce63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153779680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6708608d-b05e-456c-9981-ca009717458d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd0b7eaf3f4870a782b6617e6a4eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:26Z,use_quota=True,user_id='932584dc1cf848da80a0b5783fbc7089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8d7e93-11fd-4888-b440-6bcee62cdb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8d7e93-11fd-4888-b440-6bcee62cdb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d4a1ea-35c0-4731-987b-41d06677b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d4a1ea-35c0-4731-987b-41d06677b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6708608d-b05e-456c-9981-ca009717458d', 'volume_name': 'volume-6708608d-b05e-456c-9981-ca009717458d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df3a132-7871-4900-bba8-12217a171363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df3a132-7871-4900-bba8-12217a171363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0998f48-accb-4eae-b47b-4593c5421f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Volume 6708608d-b05e-456c-9981-ca009717458d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6708608d-b05e-456c-9981-ca009717458d', 'volume_size': 1}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153779680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6708608d-b05e-456c-9981-ca009717458d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd0b7eaf3f4870a782b6617e6a4eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:26Z,use_quota=True,user_id='932584dc1cf848da80a0b5783fbc7089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Creating volume 6708608d-b05e-456c-9981-ca009717458d {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:26 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:26 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d 1073741824
Sep 29 18:35:26 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:26 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c.4cd4a94b-8208-42dd-abd2-d05a220a9e1c" returned: 0 in 0.309s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-4cd4a94b-8208-42dd-abd2-d05a220a9e1c" released by "_delete_snapshot" :: held 1.858s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-a05245e6-3675-4b40-bbe5-965d9f1a5f4c" released by "delete_snapshot" :: held 1.895s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:26 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590" returned: 0 in 0.461s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created reservations ['3e2a35dd-f74b-42f3-81d5-d5bfd8a26e44', '7e8faf59-081f-4f22-9337-eacb9d6e45e0', '546ae749-d6e5-4d66-ab7d-c983980acc8d', '09de5f95-3986-47d8-b92d-7a82e77f598d'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:26 devstack sudo[107934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590
Sep 29 18:35:26 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Delete snapshot completed successfully.
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-613c2e03-b66b-43c9-ac98-d30ed90b9085 tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-4cd4a94b-8208-42dd-abd2-d05a220a9e1c-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:26 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d 1073741824" returned: 0 in 0.528s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:26 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0.86cb229f-2a78-446f-970c-b7252fb03590" returned: 0 in 0.314s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-86cb229f-2a78-446f-970c-b7252fb03590" released by "_delete_snapshot" :: held 1.862s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b0ac5df8-5a37-47f5-9873-10483ba4c2c0" released by "delete_snapshot" :: held 1.892s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:26 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d
Sep 29 18:35:26 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Created reservations ['75861082-8223-4e94-a7a3-6f65649bba65', '6e083f64-8851-43db-8c33-191d42050d11', 'aa72cfc1-3059-4d74-a25f-279d7d717510', '4cc27be1-c15c-45b1-9e2b-005250aabfa4'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Delete snapshot completed successfully.
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3a04a505-1914-486b-98ab-828cb8a4f595 tempest-ProjectMemberTests-918657444 None] Lock "cinder-86cb229f-2a78-446f-970c-b7252fb03590-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-b0ac5df8-5a37-47f5-9873-10483ba4c2c0-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:26 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d" returned: 0 in 0.254s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.795s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0998f48-accb-4eae-b47b-4593c5421f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6708608d-b05e-456c-9981-ca009717458d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12a8f52-cdb8-4ff2-8660-59b9ac8dbb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Lock "cinder-b0ac5df8-5a37-47f5-9873-10483ba4c2c0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] Creating offline snapshot 8795d1f0-732e-49a6-8602-5c7412af2b5f of volume 7c6b6531-66e7-476a-8f32-62890c286376 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:35:27 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Volume volume-6708608d-b05e-456c-9981-ca009717458d (6708608d-b05e-456c-9981-ca009717458d): created successfully
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12a8f52-cdb8-4ff2-8660-59b9ac8dbb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Flow 'volume_create_manager' (e9978a33-e1af-4455-b36f-0c31a8b8bcb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0cb18d-ac37-4006-9a60-c2fcc4d40e86]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-89d50d12-efa5-4656-86f3-9edcbd6db78e tempest-ProjectReaderTests-1134823584 None] Created volume successfully.
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-b0ac5df8-5a37-47f5-9873-10483ba4c2c0" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b0ac5df8-5a37-47f5-9873-10483ba4c2c0" acquired by "delete_volume" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec6dad-bdb8-4487-9f1c-829f69a619df]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:27 devstack sudo[107944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376
Sep 29 18:35:27 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:27 devstack sudo[107945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0
Sep 29 18:35:27 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:27 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376" returned: 0 in 0.366s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:27 devstack sudo[107951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f 1G
Sep 29 18:35:27 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:27 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0" returned: 0 in 0.392s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-a05245e6-3675-4b40-bbe5-965d9f1a5f4c-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:27 devstack sudo[107956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0
Sep 29 18:35:27 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-a05245e6-3675-4b40-bbe5-965d9f1a5f4c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "cinder-quobyte-a05245e6-3675-4b40-bbe5-965d9f1a5f4c" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-a05245e6-3675-4b40-bbe5-965d9f1a5f4c" acquired by "delete_volume" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7e38bb-bcfa-4660-ab1a-afc037f0762f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:27 devstack sudo[107960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c
Sep 29 18:35:27 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:27 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b0ac5df8-5a37-47f5-9873-10483ba4c2c0" returned: 0 in 0.301s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b0ac5df8-5a37-47f5-9873-10483ba4c2c0" released by "delete_volume" :: held 0.780s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:27 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f 1G" returned: 0 in 0.477s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c6b6531-66e7-476a-8f32-62890c286376 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:27 devstack sudo[107965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c6b6531-66e7-476a-8f32-62890c286376 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f
Sep 29 18:35:27 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:27 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Created reservations ['409ac11a-b386-425c-8d99-7baae977f24d', 'f78ac955-1752-4466-ae48-27501d49233c', '5c081019-2c42-41e4-8dbd-0bc5b1243e64', '3560c54c-d634-4875-ae8e-f943eef3ff64'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:28 devstack sudo[107969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:28 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:28 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c" returned: 0 in 0.503s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:28 devstack sudo[107976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c
Sep 29 18:35:28 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:28 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c6b6531-66e7-476a-8f32-62890c286376 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f" returned: 0 in 0.393s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:28 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f is being set with open permissions: ugo+rw
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:28 devstack sudo[107978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f
Sep 29 18:35:28 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:28 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.375s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:28 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Deleted volume successfully.
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8d8c21be-ba39-4c35-b77e-9c660342d544 tempest-ProjectMemberTests-918657444 None] Lock "cinder-b0ac5df8-5a37-47f5-9873-10483ba4c2c0-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:28 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a05245e6-3675-4b40-bbe5-965d9f1a5f4c" returned: 0 in 0.374s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-quobyte-a05245e6-3675-4b40-bbe5-965d9f1a5f4c" released by "delete_volume" :: held 0.958s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:28 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f" returned: 0 in 0.323s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:28 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.info
Sep 29 18:35:28 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Created reservations ['a62adc17-31db-4abc-835e-7f8bcae1e572', '559a1b19-8039-4925-83e8-3cfad1091071', '0ce9cb8a-b2fc-4def-b0dd-64d1febfe4d6', 'cf240197-02eb-4bde-8a64-aa5c9600e8c0'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (1d45e086-8b5b-4fa3-99e2-ecff505781b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2e8543-26ce-42d2-a8d2-a677fbbdc689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2e8543-26ce-42d2-a8d2-a677fbbdc689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920153023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6854c1-f97f-4a9f-96af-571b63c9093b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:29Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871d1cca-b943-42da-954f-dffc48aef4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871d1cca-b943-42da-954f-dffc48aef4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92671d2-d064-4db2-bf78-6255bb70069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92671d2-d064-4db2-bf78-6255bb70069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6854c1-f97f-4a9f-96af-571b63c9093b', 'volume_name': 'volume-0c6854c1-f97f-4a9f-96af-571b63c9093b', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a793f2c-716e-4995-b00c-e073ff2ccce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a793f2c-716e-4995-b00c-e073ff2ccce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32002882-e55f-4640-8f51-05de59f60377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:28 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Volume 0c6854c1-f97f-4a9f-96af-571b63c9093b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6854c1-f97f-4a9f-96af-571b63c9093b', 'volume_size': 1}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:28 devstack sudo[107985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:28 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:28 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.info" returned: 0 in 0.264s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:28 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.info is being set with open permissions: ugo+rw
Sep 29 18:35:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:28 devstack sudo[107988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.info
Sep 29 18:35:28 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:29 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.247s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:29 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:29 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Deleted volume successfully.
Sep 29 18:35:29 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-264e57bf-a97d-4062-8db6-8097b9b873ab tempest-CreateVolumesFromSnapshotTest-1637348773 None] Lock "cinder-a05245e6-3675-4b40-bbe5-965d9f1a5f4c-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:29 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.info" returned: 0 in 0.246s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.837s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:29 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] Creating offline snapshot b448b2a3-578e-41b6-9b15-6427913a65d2 of volume 6708608d-b05e-456c-9981-ca009717458d {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:35:29 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fb24c79e-2202-483d-820a-45d9f6657f85 tempest-SnapshotDependencyTests-929259875 None] Create snapshot completed successfully
Sep 29 18:35:29 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71d2622-9687-4ac8-816c-26a52f28171b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:29 devstack sudo[107992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d
Sep 29 18:35:29 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:29 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d" returned: 0 in 0.376s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:29 devstack sudo[107997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2 1G
Sep 29 18:35:29 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Flow 'volume_create_manager' (7546a6d1-f380-449b-986a-5bbfbafbb5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1325fad7-fdb0-47b5-8e90-f2d0953c2b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1325fad7-fdb0-47b5-8e90-f2d0953c2b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8bd22f-3f73-4aa2-bad2-7b81be85dead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc872fa188947c4bffe65b5b54c7885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8795d1f0-732e-49a6-8602-5c7412af2b5f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:30Z,use_quota=True,user_id='360cb9c1dc9047a4a4ceee6e9db22605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65deaadc-391e-4ee6-b67c-44d7fec93016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65deaadc-391e-4ee6-b67c-44d7fec93016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d628ca8-cd73-42fe-b192-573bc14a90d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:30 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d628ca8-cd73-42fe-b192-573bc14a90d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad8bd22f-3f73-4aa2-bad2-7b81be85dead', 'volume_name': 'volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead', 'volume_size': 1, 'snapshot_id': '8795d1f0-732e-49a6-8602-5c7412af2b5f'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74edf23-7132-4dbb-b96d-1aef86744d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74edf23-7132-4dbb-b96d-1aef86744d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92756495-cea3-4b47-b488-a48b89d59bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:30 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Volume ad8bd22f-3f73-4aa2-bad2-7b81be85dead: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead', 'volume_size': 1, 'snapshot_id': '8795d1f0-732e-49a6-8602-5c7412af2b5f'}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2 1G" returned: 0 in 0.524s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6708608d-b05e-456c-9981-ca009717458d -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:30 devstack sudo[108003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6708608d-b05e-456c-9981-ca009717458d -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2
Sep 29 18:35:30 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:30 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6708608d-b05e-456c-9981-ca009717458d -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2" returned: 0 in 0.316s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:30 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2 is being set with open permissions: ugo+rw
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:30 devstack sudo[108022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2
Sep 29 18:35:30 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:30 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2" returned: 0 in 0.315s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:30 devstack sudo[108047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.info
Sep 29 18:35:30 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:31 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.info" returned: 0 in 0.286s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:31 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.info is being set with open permissions: ugo+rw
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:31 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.info
Sep 29 18:35:31 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:31 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.info" returned: 0 in 0.298s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.585s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920153023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6854c1-f97f-4a9f-96af-571b63c9093b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:29Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Creating volume 0c6854c1-f97f-4a9f-96af-571b63c9093b {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:31 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:31 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b 1073741824
Sep 29 18:35:31 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:31 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ee9e32d6-47a8-48c7-8a13-b95823faca00 tempest-ProjectReaderTests-1134823584 None] Create snapshot completed successfully
Sep 29 18:35:31 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b 1073741824" returned: 0 in 0.509s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:32 devstack sudo[108066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b
Sep 29 18:35:32 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:32 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b" returned: 0 in 0.295s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.121s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "cinder-quobyte-8795d1f0-732e-49a6-8602-5c7412af2b5f-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" by "_create_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32002882-e55f-4640-8f51-05de59f60377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6854c1-f97f-4a9f-96af-571b63c9093b', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027450e6-eb10-47f9-a5d7-611c725371f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-8795d1f0-732e-49a6-8602-5c7412af2b5f-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Creating volume ad8bd22f-3f73-4aa2-bad2-7b81be85dead from snapshot 8795d1f0-732e-49a6-8602-5c7412af2b5f {{(pid=86821) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "cinder-quobyte-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" by "_copy_volume_from_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:32 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Volume volume-0c6854c1-f97f-4a9f-96af-571b63c9093b (0c6854c1-f97f-4a9f-96af-571b63c9093b): created successfully
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027450e6-eb10-47f9-a5d7-611c725371f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (1d45e086-8b5b-4fa3-99e2-ecff505781b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:32 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1a15dd06-5072-4e5c-9795-8af8913144ea tempest-ProjectMemberTests-918657444 None] Created volume successfully.
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] snapshot: 8795d1f0-732e-49a6-8602-5c7412af2b5f, volume: ad8bd22f-3f73-4aa2-bad2-7b81be85dead,  {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118e1f0-db2b-43e4-a59f-2878086e348e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:32 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f
Sep 29 18:35:32 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-b448b2a3-578e-41b6-9b15-6427913a65d2-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Lock "cinder-b448b2a3-578e-41b6-9b15-6427913a65d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-6708608d-b05e-456c-9981-ca009717458d" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-6708608d-b05e-456c-9981-ca009717458d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-b448b2a3-578e-41b6-9b15-6427913a65d2" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-b448b2a3-578e-41b6-9b15-6427913a65d2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Deleting offline snapshot b448b2a3-578e-41b6-9b15-6427913a65d2 of volume 6708608d-b05e-456c-9981-ca009717458d {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] snapshot_file for this snap is: volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb7bf94-f56e-4546-ba82-96b9b96bae45]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:32 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f" returned: 0 in 0.505s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c6b6531-66e7-476a-8f32-62890c286376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f88401e-e166-4a20-ac2a-b367c20a8440]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:32 devstack sudo[108073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2
Sep 29 18:35:32 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Flow 'volume_create_manager' (c5cd1571-68cb-4db6-9b9c-bbc8b6ca0cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9341de6-0e9e-4c22-942b-4c7cca39c097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9341de6-0e9e-4c22-942b-4c7cca39c097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5597be2e-912f-4115-94a9-04c226ea66a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907cde2e18264304b70d6d5adeb6c746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:33Z,use_quota=True,user_id='6ac83a8069d8489486f8ee1b0bf5b19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c3dcee-334f-4c40-a8e4-099eb936fcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c3dcee-334f-4c40-a8e4-099eb936fcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b5c876-e20f-4a23-9224-0cdb0a5fe6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b5c876-e20f-4a23-9224-0cdb0a5fe6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5597be2e-912f-4115-94a9-04c226ea66a9', 'volume_name': 'volume-5597be2e-912f-4115-94a9-04c226ea66a9', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:33 devstack sudo[108075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376
Sep 29 18:35:33 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aeba9f6-b87b-480e-8034-61c9ae3c8812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aeba9f6-b87b-480e-8034-61c9ae3c8812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbd0f95-1657-4c33-8689-a59446213c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:33 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Volume 5597be2e-912f-4115-94a9-04c226ea66a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5597be2e-912f-4115-94a9-04c226ea66a9', 'volume_size': 1}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:33 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2" returned: 0 in 0.515s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6708608d-b05e-456c-9981-ca009717458d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2181416f-8983-4aa4-a3fa-ebc756d37c48]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:33 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376" returned: 0 in 0.487s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Creating direct copy from snapshot {{(pid=86821) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG cinder.utils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Path /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead not found in is_blk_device check {{(pid=86821) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:33 devstack sudo[108086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead
Sep 29 18:35:33 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:33 devstack sudo[108084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d
Sep 29 18:35:33 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:33 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d" returned: 0 in 0.397s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:33 devstack sudo[108096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2
Sep 29 18:35:33 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:34 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2" returned: 0 in 0.511s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:34 devstack sudo[108109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2
Sep 29 18:35:34 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:34 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d.b448b2a3-578e-41b6-9b15-6427913a65d2" returned: 0 in 0.368s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-b448b2a3-578e-41b6-9b15-6427913a65d2" released by "_delete_snapshot" :: held 1.926s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-6708608d-b05e-456c-9981-ca009717458d" released by "delete_snapshot" :: held 1.954s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:34 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Created reservations ['47c7c975-f6df-43a4-a013-c86a1fec0546', 'bccc67ba-2a76-4313-9391-4cc53d5d44ac', 'f133f719-4d14-49eb-9f8d-441f2a9a2ae2', 'ebacba8b-20c9-4f3a-a4cd-2ea7835c6c21'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:34 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Delete snapshot completed successfully.
Sep 29 18:35:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-be6fb97b-3e71-4fd1-b73a-89c54b66f50b tempest-ProjectReaderTests-1134823584 None] Lock "cinder-b448b2a3-578e-41b6-9b15-6427913a65d2-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-6708608d-b05e-456c-9981-ca009717458d-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-6708608d-b05e-456c-9981-ca009717458d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-6708608d-b05e-456c-9981-ca009717458d" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:36 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-6708608d-b05e-456c-9981-ca009717458d" acquired by "delete_volume" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:36 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[addac7af-8f2a-444b-8c37-019b9a53c865]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:36 devstack sudo[108112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d
Sep 29 18:35:36 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:36 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d" returned: 0 in 0.616s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:36 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:36 devstack sudo[108118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d
Sep 29 18:35:36 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:37 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-6708608d-b05e-456c-9981-ca009717458d" returned: 0 in 0.392s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:37 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-6708608d-b05e-456c-9981-ca009717458d" released by "delete_volume" :: held 1.186s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:37 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Created reservations ['738c61f7-67a6-422e-9ee7-881ac46e297b', '0e6e4b94-0e0b-465f-85dd-18274d00e77f', '46626d55-5acf-427e-8b73-b3628ed4fffe', '36a8089a-e0b8-40e1-ad43-91e49bc7fbcb'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:37 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:37 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:37 devstack sudo[108121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:37 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:38 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:38 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.322s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:38 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:38 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Deleted volume successfully.
Sep 29 18:35:38 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-795db5eb-d10d-4510-8fd8-d3346e83b6b1 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-6708608d-b05e-456c-9981-ca009717458d-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Flow 'volume_create_manager' (8c12b0d8-ad81-400c-8cd0-36a536abddae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d7e096-5480-4a8b-b434-7a38c6c2f991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d7e096-5480-4a8b-b434-7a38c6c2f991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867821256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f30fd91-d49e-4b70-8191-2cdd572ec649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd0b7eaf3f4870a782b6617e6a4eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:39Z,use_quota=True,user_id='932584dc1cf848da80a0b5783fbc7089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0367cfb7-b36c-4c25-8074-2741d72e72e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0367cfb7-b36c-4c25-8074-2741d72e72e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7792302a-64d2-49d1-84dd-4174dcbad59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7792302a-64d2-49d1-84dd-4174dcbad59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f30fd91-d49e-4b70-8191-2cdd572ec649', 'volume_name': 'volume-4f30fd91-d49e-4b70-8191-2cdd572ec649', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d78551-0508-464e-823c-e19cd1324979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d78551-0508-464e-823c-e19cd1324979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd7141e-67e2-4a1c-ad4c-17ac6e221eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:39 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Volume 4f30fd91-d49e-4b70-8191-2cdd572ec649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f30fd91-d49e-4b70-8191-2cdd572ec649', 'volume_size': 1}
Sep 29 18:35:39 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:40 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" returned: 0 in 6.715s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.image.image_utils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Image conversion details: src /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead {{(pid=86821) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 29 18:35:40 devstack cinder-volume[86821]: INFO cinder.image.image_utils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Converted 1024.00 MB image at 152.47 MB/s
Sep 29 18:35:40 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead is being set with open permissions: ugo+rw
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:40 devstack sudo[108124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead
Sep 29 18:35:40 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:40 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" returned: 0 in 0.229s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" released by "_copy_volume_from_snapshot" :: held 8.033s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-8795d1f0-732e-49a6-8602-5c7412af2b5f-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" released by "_create_volume_from_snapshot" :: held 8.116s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.150s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.262s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5597be2e-912f-4115-94a9-04c226ea66a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907cde2e18264304b70d6d5adeb6c746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:33Z,use_quota=True,user_id='6ac83a8069d8489486f8ee1b0bf5b19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Creating volume 5597be2e-912f-4115-94a9-04c226ea66a9 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:40 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:40 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9 1073741824
Sep 29 18:35:40 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92756495-cea3-4b47-b488-a48b89d59bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead', 'volume_size': 1, 'snapshot_id': '8795d1f0-732e-49a6-8602-5c7412af2b5f'}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f701bd-7a79-4ea7-b35e-3a1eebb57832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:40 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Volume volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead (ad8bd22f-3f73-4aa2-bad2-7b81be85dead): created successfully
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f701bd-7a79-4ea7-b35e-3a1eebb57832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Flow 'volume_create_manager' (7546a6d1-f380-449b-986a-5bbfbafbb5d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:40 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fb5861c4-fc00-46f4-a2af-1a030ea16824 tempest-SnapshotDependencyTests-929259875 None] Created volume successfully.
Sep 29 18:35:40 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9 1073741824" returned: 0 in 0.426s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:40 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:40 devstack sudo[108133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9
Sep 29 18:35:40 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "cinder-8795d1f0-732e-49a6-8602-5c7412af2b5f-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-8795d1f0-732e-49a6-8602-5c7412af2b5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "cinder-quobyte-7c6b6531-66e7-476a-8f32-62890c286376" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-7c6b6531-66e7-476a-8f32-62890c286376" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "cinder-quobyte-8795d1f0-732e-49a6-8602-5c7412af2b5f" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-8795d1f0-732e-49a6-8602-5c7412af2b5f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Deleting offline snapshot 8795d1f0-732e-49a6-8602-5c7412af2b5f of volume 7c6b6531-66e7-476a-8f32-62890c286376 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] snapshot_file for this snap is: volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:35:41 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9" returned: 0 in 0.274s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d7d67a-1ad1-4436-b50e-d22b8035d9ab]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.972s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] Creating offline snapshot 8a40892f-1180-4285-b524-f1d49dcc1b91 of volume 0c6854c1-f97f-4a9f-96af-571b63c9093b {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbd0f95-1657-4c33-8689-a59446213c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5597be2e-912f-4115-94a9-04c226ea66a9', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c41ca96-f3ca-427a-a7dd-7035d83f7f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6e4cd4-6dc3-4e3d-af0b-e05845b98c6c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:41 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Volume volume-5597be2e-912f-4115-94a9-04c226ea66a9 (5597be2e-912f-4115-94a9-04c226ea66a9): created successfully
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c41ca96-f3ca-427a-a7dd-7035d83f7f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Flow 'volume_create_manager' (c5cd1571-68cb-4db6-9b9c-bbc8b6ca0cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:41 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f15e2a78-85e0-4772-bde6-cdd39c4f8864 tempest-CinderUnicodeTest-1217294757 None] Created volume successfully.
Sep 29 18:35:41 devstack sudo[108136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f
Sep 29 18:35:41 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:41 devstack sudo[108137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b
Sep 29 18:35:41 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:41 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f" returned: 0 in 0.405s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c6b6531-66e7-476a-8f32-62890c286376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e5cca0-c97c-499d-975a-edb3f74299fb]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:41 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b" returned: 0 in 0.410s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:41 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:41 devstack sudo[108147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91 1G
Sep 29 18:35:41 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:41 devstack sudo[108146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376
Sep 29 18:35:41 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:42 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91 1G" returned: 0 in 0.473s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6854c1-f97f-4a9f-96af-571b63c9093b -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:42 devstack sudo[108156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6854c1-f97f-4a9f-96af-571b63c9093b -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91
Sep 29 18:35:42 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:42 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376" returned: 0 in 0.652s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:42 devstack sudo[108159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f
Sep 29 18:35:42 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:42 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c6854c1-f97f-4a9f-96af-571b63c9093b -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91" returned: 0 in 0.349s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:42 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91 is being set with open permissions: ugo+rw
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:42 devstack sudo[108165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91
Sep 29 18:35:42 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Flow 'volume_create_manager' (301077a3-6bed-4914-a5bc-125b2a3ed3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747be557-97fd-45c5-9bb3-382433b45356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747be557-97fd-45c5-9bb3-382433b45356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-589684875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8dff7c-c335-4739-b351-2b5f5d7ae33a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907cde2e18264304b70d6d5adeb6c746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:43Z,use_quota=True,user_id='6ac83a8069d8489486f8ee1b0bf5b19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51d3bc0-5518-48b3-b040-d2c23ca7e1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51d3bc0-5518-48b3-b040-d2c23ca7e1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a265ee1-462c-4b65-83b6-892aec5664d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a265ee1-462c-4b65-83b6-892aec5664d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8dff7c-c335-4739-b351-2b5f5d7ae33a', 'volume_name': 'volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77599cd-ad5a-4dbf-88da-ec7f4f761067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77599cd-ad5a-4dbf-88da-ec7f4f761067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaa0009-9a0f-4aa4-8542-6577866a3d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:42 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Volume 1c8dff7c-c335-4739-b351-2b5f5d7ae33a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a', 'volume_size': 1}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:42 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f" returned: 0 in 0.421s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:42 devstack sudo[108171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f
Sep 29 18:35:42 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:42 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91" returned: 0 in 0.296s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:42 devstack sudo[108174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.info
Sep 29 18:35:42 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:42 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:42 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376.8795d1f0-732e-49a6-8602-5c7412af2b5f" returned: 0 in 0.251s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-8795d1f0-732e-49a6-8602-5c7412af2b5f" released by "_delete_snapshot" :: held 1.862s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-7c6b6531-66e7-476a-8f32-62890c286376" released by "delete_snapshot" :: held 1.893s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Created reservations ['4ea49a48-235f-4252-94ee-db50f6fe00d3', '39a8bd8c-2d3d-49aa-a828-c02e6010ccef', '72fc7692-3c66-40a6-988b-ae0fb4c1eb60', '440e63b1-d6f9-428a-95a9-6abf9495cb18'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:43 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.info" returned: 0 in 0.269s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:43 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.info is being set with open permissions: ugo+rw
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:43 devstack sudo[108178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.info
Sep 29 18:35:43 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:43 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Delete snapshot completed successfully.
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2a2bbc2c-74a4-421e-b6a7-a0786b910685 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-8795d1f0-732e-49a6-8602-5c7412af2b5f-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "cinder-7c6b6531-66e7-476a-8f32-62890c286376-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-7c6b6531-66e7-476a-8f32-62890c286376-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "cinder-quobyte-7c6b6531-66e7-476a-8f32-62890c286376" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-7c6b6531-66e7-476a-8f32-62890c286376" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:43 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.info" returned: 0 in 0.292s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.204s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[001cfa97-8335-4121-8cee-e0517a40da6e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.069s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867821256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f30fd91-d49e-4b70-8191-2cdd572ec649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd0b7eaf3f4870a782b6617e6a4eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:39Z,use_quota=True,user_id='932584dc1cf848da80a0b5783fbc7089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Creating volume 4f30fd91-d49e-4b70-8191-2cdd572ec649 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:43 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:43 devstack sudo[108182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 1073741824
Sep 29 18:35:43 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:43 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ad011161-7089-4e05-bd2c-472c43702d2a tempest-ProjectMemberTests-918657444 None] Create snapshot completed successfully
Sep 29 18:35:43 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376
Sep 29 18:35:43 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-8a40892f-1180-4285-b524-f1d49dcc1b91-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Lock "cinder-8a40892f-1180-4285-b524-f1d49dcc1b91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-0c6854c1-f97f-4a9f-96af-571b63c9093b" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-0c6854c1-f97f-4a9f-96af-571b63c9093b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-8a40892f-1180-4285-b524-f1d49dcc1b91" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-8a40892f-1180-4285-b524-f1d49dcc1b91" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Deleting offline snapshot 8a40892f-1180-4285-b524-f1d49dcc1b91 of volume 0c6854c1-f97f-4a9f-96af-571b63c9093b {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] snapshot_file for this snap is: volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3985bb96-ebbb-4403-8524-6a89a86a84b5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:43 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376" returned: 0 in 0.450s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:43 devstack sudo[108194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376
Sep 29 18:35:43 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:43 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 1073741824" returned: 0 in 0.513s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:43 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:43 devstack sudo[108193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91
Sep 29 18:35:43 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:43 devstack sudo[108196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649
Sep 29 18:35:43 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:44 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-7c6b6531-66e7-476a-8f32-62890c286376" returned: 0 in 0.268s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-7c6b6531-66e7-476a-8f32-62890c286376" released by "delete_volume" :: held 0.813s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:44 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Created reservations ['f6919041-0845-4cbb-ace8-cbf95828b7a5', '7f3b26be-a6ec-404f-a7a5-2bf49712d5ae', '20b818af-f082-4b84-b36c-f640def80afb', '91fb37b2-b665-468a-951a-09cb78821010'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649" returned: 0 in 0.266s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.568s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-589684875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8dff7c-c335-4739-b351-2b5f5d7ae33a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='907cde2e18264304b70d6d5adeb6c746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:43Z,use_quota=True,user_id='6ac83a8069d8489486f8ee1b0bf5b19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Creating volume 1c8dff7c-c335-4739-b351-2b5f5d7ae33a {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:44 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:44 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91" returned: 0 in 0.415s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c6854c1-f97f-4a9f-96af-571b63c9093b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:35:44 devstack sudo[108204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a 1073741824
Sep 29 18:35:44 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd7141e-67e2-4a1c-ad4c-17ac6e221eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f30fd91-d49e-4b70-8191-2cdd572ec649', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7c92df-0205-4f42-8aba-405df6a3ef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aea7e7-a4ba-4d81-b32e-3e07f3d99ac9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:44 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Volume volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 (4f30fd91-d49e-4b70-8191-2cdd572ec649): created successfully
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7c92df-0205-4f42-8aba-405df6a3ef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Flow 'volume_create_manager' (8c12b0d8-ad81-400c-8cd0-36a536abddae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:44 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1126f6bb-6598-465c-8029-57eb38ae4db5 tempest-ProjectReaderTests-1134823584 None] Created volume successfully.
Sep 29 18:35:44 devstack sudo[108206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b
Sep 29 18:35:44 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "cinder-ad8bd22f-3f73-4aa2-bad2-7b81be85dead-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:44 devstack sudo[108208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:44 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-ad8bd22f-3f73-4aa2-bad2-7b81be85dead-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "cinder-quobyte-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" acquired by "delete_volume" :: waited 0.033s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[489d7ce3-8478-4496-82a2-b4c06f050a21]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:44 devstack sudo[108213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead
Sep 29 18:35:44 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:44 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b" returned: 0 in 0.601s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:44 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a 1073741824" returned: 0 in 0.683s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:44 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:44 devstack sudo[108221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91
Sep 29 18:35:44 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.486s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:44 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Deleted volume successfully.
Sep 29 18:35:44 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0d08c823-0a6f-462a-966b-c0b618f53287 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-7c6b6531-66e7-476a-8f32-62890c286376-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:45 devstack sudo[108223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a
Sep 29 18:35:45 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:45 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" returned: 0 in 0.460s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:45 devstack sudo[108230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead
Sep 29 18:35:45 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:45 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a" returned: 0 in 0.288s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.383s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:45 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcaa0009-9a0f-4aa4-8542-6577866a3d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834d5fab-fb4e-4368-a35d-9e0945cd565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91" returned: 0 in 0.395s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] Creating offline snapshot fd6ed21c-347c-4a56-a170-cf237449be5b of volume 4f30fd91-d49e-4b70-8191-2cdd572ec649 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:35:45 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91
Sep 29 18:35:45 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:45 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Volume volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a (1c8dff7c-c335-4739-b351-2b5f5d7ae33a): created successfully
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834d5fab-fb4e-4368-a35d-9e0945cd565f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Flow 'volume_create_manager' (301077a3-6bed-4914-a5bc-125b2a3ed3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22834c8-47d3-4809-831d-cfbd1e99b76d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-763fcb2f-f091-47f9-902a-b1459dcff29f tempest-CinderUnicodeTest-1217294757 None] Created volume successfully.
Sep 29 18:35:45 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" returned: 0 in 0.265s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-quobyte-ad8bd22f-3f73-4aa2-bad2-7b81be85dead" released by "delete_volume" :: held 0.795s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:45 devstack sudo[108237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649
Sep 29 18:35:45 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Created reservations ['0d7989fd-d021-424a-8148-183d49302107', '373aadac-03ca-4ec0-a249-172540708b12', 'f7841332-c0c2-4721-9de8-362c02309906', 'e19f5e77-11e0-4c3e-9b74-a0f17b95b6e6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:45 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b.8a40892f-1180-4285-b524-f1d49dcc1b91" returned: 0 in 0.301s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:45 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:45 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-8a40892f-1180-4285-b524-f1d49dcc1b91" released by "_delete_snapshot" :: held 1.878s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-0c6854c1-f97f-4a9f-96af-571b63c9093b" released by "delete_snapshot" :: held 1.912s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:45 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649" returned: 0 in 0.479s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Created reservations ['2e75a52c-6ca2-4c74-8cdc-a3e456d18f99', 'c7f960f4-3bac-47aa-9d89-2b2cc8836c50', '34224337-4cd6-495e-beaa-46bc8c0bfdbc', 'bd8c536e-5b9a-4d4e-b347-648796c94082'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:45 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b 1G
Sep 29 18:35:45 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:45 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.366s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:45 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:45 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Deleted volume successfully.
Sep 29 18:35:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-e48a8dea-c958-4f9b-88b5-9fff5e983656 tempest-SnapshotDependencyTests-929259875 None] Lock "cinder-ad8bd22f-3f73-4aa2-bad2-7b81be85dead-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:46 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Delete snapshot completed successfully.
Sep 29 18:35:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-01bed0c3-5858-4f17-951a-967681946c50 tempest-ProjectMemberTests-918657444 None] Lock "cinder-8a40892f-1180-4285-b524-f1d49dcc1b91-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:46 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b 1G" returned: 0 in 0.519s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:46 devstack sudo[108253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b
Sep 29 18:35:46 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:46 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b" returned: 0 in 0.327s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:46 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b is being set with open permissions: ugo+rw
Sep 29 18:35:46 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:46 devstack sudo[108258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b
Sep 29 18:35:46 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:46 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-0c6854c1-f97f-4a9f-96af-571b63c9093b-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:47 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b" returned: 0 in 0.310s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Lock "cinder-0c6854c1-f97f-4a9f-96af-571b63c9093b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:47 devstack sudo[108261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.info
Sep 29 18:35:47 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-0c6854c1-f97f-4a9f-96af-571b63c9093b" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-0c6854c1-f97f-4a9f-96af-571b63c9093b" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e816d41-a1e2-488d-b94e-b6b059fadc28]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:47 devstack sudo[108263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b
Sep 29 18:35:47 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:47 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.info" returned: 0 in 0.288s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:47 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.info is being set with open permissions: ugo+rw
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:47 devstack sudo[108266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.info
Sep 29 18:35:47 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:47 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b" returned: 0 in 0.437s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:47 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.info" returned: 0 in 0.289s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:47 devstack sudo[108273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b
Sep 29 18:35:47 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.552s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] Creating offline snapshot a63c7046-b6ef-458e-ab50-31dc715b17dc of volume 1c8dff7c-c335-4739-b351-2b5f5d7ae33a {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:35:47 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2fa82d3f-28e4-4143-baf5-1431716bfcaa tempest-ProjectReaderTests-1134823584 None] Create snapshot completed successfully
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7912010-9553-4068-9f49-10ef78fead10]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:47 devstack sudo[108275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a
Sep 29 18:35:47 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:47 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-0c6854c1-f97f-4a9f-96af-571b63c9093b" returned: 0 in 0.275s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:47 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-0c6854c1-f97f-4a9f-96af-571b63c9093b" released by "delete_volume" :: held 0.802s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Created reservations ['66329f9e-90db-4522-b601-4bd9bf0d9ee7', '3baa0110-2e06-49a4-83d3-2cd95f4dbb20', '174f0036-223c-44a2-ae4e-0adafedee170', '632d0908-d97b-4cba-9a62-66b78cd083e0'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-fd6ed21c-347c-4a56-a170-cf237449be5b-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:48 devstack sudo[108282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:48 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:48 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a" returned: 0 in 0.482s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-fd6ed21c-347c-4a56-a170-cf237449be5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-4f30fd91-d49e-4b70-8191-2cdd572ec649" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:48 devstack sudo[108284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc 1G
Sep 29 18:35:48 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-4f30fd91-d49e-4b70-8191-2cdd572ec649" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-fd6ed21c-347c-4a56-a170-cf237449be5b" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-fd6ed21c-347c-4a56-a170-cf237449be5b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Deleting offline snapshot fd6ed21c-347c-4a56-a170-cf237449be5b of volume 4f30fd91-d49e-4b70-8191-2cdd572ec649 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] snapshot_file for this snap is: volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8d9c86-1ea9-43fe-b0cb-7c9ebe363ea2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:48 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.399s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:48 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Deleted volume successfully.
Sep 29 18:35:48 devstack sudo[108286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b
Sep 29 18:35:48 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2da6b990-154f-4388-9090-46e88f625876 tempest-ProjectMemberTests-918657444 None] Lock "cinder-0c6854c1-f97f-4a9f-96af-571b63c9093b-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:48 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc 1G" returned: 0 in 0.630s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:48 devstack sudo[108294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc
Sep 29 18:35:48 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:48 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b" returned: 0 in 0.573s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f30fd91-d49e-4b70-8191-2cdd572ec649(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a12b7-75f6-4ca0-8403-7bceedaadfd7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:48 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (a278e3af-3561-45a8-a684-81ddc513f812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612af559-15bb-4db2-956a-50a9fb12e34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612af559-15bb-4db2-956a-50a9fb12e34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853776567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f2f882-2bee-4f77-a348-861b3fc9a13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:49Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c51511-5b0c-4631-92eb-d2d3a608f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c51511-5b0c-4631-92eb-d2d3a608f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ab7c63-53ed-4c5c-a610-ab8c61bc6b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ab7c63-53ed-4c5c-a610-ab8c61bc6b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f2f882-2bee-4f77-a348-861b3fc9a13a', 'volume_name': 'volume-21f2f882-2bee-4f77-a348-861b3fc9a13a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe55d801-f9cb-4325-b861-be6399da03ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe55d801-f9cb-4325-b861-be6399da03ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019f4d49-0478-4403-af20-3904ea3c7f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:49 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Volume 21f2f882-2bee-4f77-a348-861b3fc9a13a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f2f882-2bee-4f77-a348-861b3fc9a13a', 'volume_size': 1}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:49 devstack sudo[108298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649
Sep 29 18:35:49 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:49 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc" returned: 0 in 0.377s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:49 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc is being set with open permissions: ugo+rw
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:49 devstack sudo[108303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc
Sep 29 18:35:49 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:49 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649" returned: 0 in 0.398s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:49 devstack sudo[108308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b
Sep 29 18:35:49 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:49 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc" returned: 0 in 0.284s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:49 devstack sudo[108311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.info
Sep 29 18:35:49 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:49 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b" returned: 0 in 0.347s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:49 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b
Sep 29 18:35:49 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:49 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.info" returned: 0 in 0.316s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:49 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.info is being set with open permissions: ugo+rw
Sep 29 18:35:49 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:49 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.info
Sep 29 18:35:49 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:50 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649.fd6ed21c-347c-4a56-a170-cf237449be5b" returned: 0 in 0.363s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-fd6ed21c-347c-4a56-a170-cf237449be5b" released by "_delete_snapshot" :: held 1.842s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-4f30fd91-d49e-4b70-8191-2cdd572ec649" released by "delete_snapshot" :: held 1.887s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:50 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.info" returned: 0 in 0.374s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.589s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.140s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853776567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f2f882-2bee-4f77-a348-861b3fc9a13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:49Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Creating volume 21f2f882-2bee-4f77-a348-861b3fc9a13a {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:50 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Created reservations ['88e2c0f6-41c2-471f-ab2f-04a584bde955', '4a8dfcc1-735c-400a-a1df-df3780817ad8', '411d0a34-652a-4cb4-a9a1-c347828b7cc1', '11988e63-fbdd-491c-88a7-dfc6f36c8a46'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:50 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a 1073741824
Sep 29 18:35:50 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:50 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-b6f70c91-f62d-45e2-9cdd-5840533fe8d8 tempest-CinderUnicodeTest-1217294757 None] Create snapshot completed successfully
Sep 29 18:35:50 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Delete snapshot completed successfully.
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-da6d7db7-197f-4f63-b78c-2debbf780b32 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-fd6ed21c-347c-4a56-a170-cf237449be5b-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-4f30fd91-d49e-4b70-8191-2cdd572ec649-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Lock "cinder-4f30fd91-d49e-4b70-8191-2cdd572ec649-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-4f30fd91-d49e-4b70-8191-2cdd572ec649" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-4f30fd91-d49e-4b70-8191-2cdd572ec649" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d817dc-0256-465e-9b72-2de0e8cf9f18]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:50 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649
Sep 29 18:35:50 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:50 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a 1073741824" returned: 0 in 0.612s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:50 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:50 devstack sudo[108333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a
Sep 29 18:35:50 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:51 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649" returned: 0 in 0.514s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:51 devstack sudo[108338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649
Sep 29 18:35:51 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:51 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a" returned: 0 in 0.328s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019f4d49-0478-4403-af20-3904ea3c7f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f2f882-2bee-4f77-a348-861b3fc9a13a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31691319-f867-4fab-bab6-90671081816a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:51 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Volume volume-21f2f882-2bee-4f77-a348-861b3fc9a13a (21f2f882-2bee-4f77-a348-861b3fc9a13a): created successfully
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31691319-f867-4fab-bab6-90671081816a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (a278e3af-3561-45a8-a684-81ddc513f812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:51 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2aeafefe-8198-45ac-a504-e6cad05c7c28 tempest-ProjectMemberTests-918657444 None] Created volume successfully.
Sep 29 18:35:51 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-4f30fd91-d49e-4b70-8191-2cdd572ec649" returned: 0 in 0.291s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-4f30fd91-d49e-4b70-8191-2cdd572ec649" released by "delete_volume" :: held 0.893s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "cinder-a63c7046-b6ef-458e-ab50-31dc715b17dc-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-a63c7046-b6ef-458e-ab50-31dc715b17dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "cinder-quobyte-1c8dff7c-c335-4739-b351-2b5f5d7ae33a" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-quobyte-1c8dff7c-c335-4739-b351-2b5f5d7ae33a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "cinder-quobyte-a63c7046-b6ef-458e-ab50-31dc715b17dc" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-quobyte-a63c7046-b6ef-458e-ab50-31dc715b17dc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Deleting offline snapshot a63c7046-b6ef-458e-ab50-31dc715b17dc of volume 1c8dff7c-c335-4739-b351-2b5f5d7ae33a {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] snapshot_file for this snap is: volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Created reservations ['7535b896-ebad-4d1e-bdb5-6c455c73aa9e', 'ea1b9842-4c6b-411f-af0f-bbdb59529ee1', 'de874c26-083d-4df7-ab34-1922558c9e22', 'e8508d93-6882-43df-b691-53a3d16339c9'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0318beb4-d466-4bbd-89ba-de7343c4240e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:51 devstack sudo[108342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc
Sep 29 18:35:51 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:51 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:51 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:51 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.303s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:51 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:52 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Deleted volume successfully.
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-9dfc06aa-68b3-499d-b987-817eae3977cb tempest-ProjectReaderTests-1134823584 None] Lock "cinder-4f30fd91-d49e-4b70-8191-2cdd572ec649-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:52 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc" returned: 0 in 0.474s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a3f144-1091-4b95-865b-12f2a210595c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:52 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a
Sep 29 18:35:52 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] Creating offline snapshot fb6325f5-75be-4e2f-923e-0bccad3a0967 of volume 21f2f882-2bee-4f77-a348-861b3fc9a13a {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed1dbed-7d74-465f-8fe7-20870abb923c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:52 devstack sudo[108353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a
Sep 29 18:35:52 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:52 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a" returned: 0 in 0.444s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:52 devstack sudo[108358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc
Sep 29 18:35:52 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:52 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a" returned: 0 in 0.462s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:52 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:52 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967 1G
Sep 29 18:35:52 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:53 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc" returned: 0 in 0.508s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:53 devstack sudo[108369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc
Sep 29 18:35:53 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:35:53 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Flow 'volume_create_manager' (c6c2105a-2a1b-4c2e-a7ae-b3277c0d0cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e58f095-9486-4f18-8ece-4f2323355e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a.a63c7046-b6ef-458e-ab50-31dc715b17dc" returned: 0 in 0.353s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e58f095-9486-4f18-8ece-4f2323355e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-379074431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c54739-5db8-47ec-afd8-3ea9063cce7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd0b7eaf3f4870a782b6617e6a4eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:53Z,use_quota=True,user_id='932584dc1cf848da80a0b5783fbc7089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9740da18-a73d-45f8-95bb-2f162d0356b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9740da18-a73d-45f8-95bb-2f162d0356b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7678837b-67d4-49d7-aef6-b981c00dd623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7678837b-67d4-49d7-aef6-b981c00dd623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18c54739-5db8-47ec-afd8-3ea9063cce7d', 'volume_name': 'volume-18c54739-5db8-47ec-afd8-3ea9063cce7d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bb203a-d0fa-4bc7-8a67-a1074b9e52eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:53 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bb203a-d0fa-4bc7-8a67-a1074b9e52eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90198629-52f9-4d39-b5aa-af2a0bf2c734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:53 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Volume 18c54739-5db8-47ec-afd8-3ea9063cce7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18c54739-5db8-47ec-afd8-3ea9063cce7d', 'volume_size': 1}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967 1G" returned: 0 in 0.658s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21f2f882-2bee-4f77-a348-861b3fc9a13a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:53 devstack sudo[108376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21f2f882-2bee-4f77-a348-861b3fc9a13a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967
Sep 29 18:35:53 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-quobyte-a63c7046-b6ef-458e-ab50-31dc715b17dc" released by "_delete_snapshot" :: held 1.991s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-quobyte-1c8dff7c-c335-4739-b351-2b5f5d7ae33a" released by "delete_snapshot" :: held 2.020s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Created reservations ['7a377835-9987-4f0f-86ef-57b6917894d0', '8ac7a26a-2155-4452-8d5d-54bbf1ca4c67', 'bf7f0895-c8fd-4b50-92ec-59735cae653c', '13981382-b6a7-41ff-b557-94e63a1f9fef'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:53 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Delete snapshot completed successfully.
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-06331e17-b26e-4c9d-bdb6-b0d657fb4960 tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-a63c7046-b6ef-458e-ab50-31dc715b17dc-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:53 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21f2f882-2bee-4f77-a348-861b3fc9a13a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967" returned: 0 in 0.353s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:53 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967 is being set with open permissions: ugo+rw
Sep 29 18:35:53 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:53 devstack sudo[108382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967
Sep 29 18:35:53 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:54 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967" returned: 0 in 0.314s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:54 devstack sudo[108385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.info
Sep 29 18:35:54 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:54 devstack sudo[108388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:54 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:54 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.info" returned: 0 in 0.288s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:54 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.info is being set with open permissions: ugo+rw
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:54 devstack sudo[108390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.info
Sep 29 18:35:54 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "cinder-1c8dff7c-c335-4739-b351-2b5f5d7ae33a-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:54 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-1c8dff7c-c335-4739-b351-2b5f5d7ae33a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.306s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "cinder-quobyte-1c8dff7c-c335-4739-b351-2b5f5d7ae33a" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:54 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-quobyte-1c8dff7c-c335-4739-b351-2b5f5d7ae33a" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.info" returned: 0 in 0.367s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32abefc-7205-4cd6-90fb-0e4ff981749e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.379s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-379074431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c54739-5db8-47ec-afd8-3ea9063cce7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd0b7eaf3f4870a782b6617e6a4eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:53Z,use_quota=True,user_id='932584dc1cf848da80a0b5783fbc7089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Creating volume 18c54739-5db8-47ec-afd8-3ea9063cce7d {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:35:54 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:54 devstack sudo[108394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d 1073741824
Sep 29 18:35:54 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:54 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-5e7ae3bf-2e79-4496-9fb9-7d296aaec837 tempest-ProjectMemberTests-918657444 None] Create snapshot completed successfully
Sep 29 18:35:55 devstack sudo[108395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a
Sep 29 18:35:55 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:55 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a" returned: 0 in 0.543s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:55 devstack sudo[108405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a
Sep 29 18:35:55 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:55 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d 1073741824" returned: 0 in 0.605s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-fb6325f5-75be-4e2f-923e-0bccad3a0967-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:55 devstack sudo[108407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d
Sep 29 18:35:55 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-fb6325f5-75be-4e2f-923e-0bccad3a0967-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-21f2f882-2bee-4f77-a348-861b3fc9a13a" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-21f2f882-2bee-4f77-a348-861b3fc9a13a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-fb6325f5-75be-4e2f-923e-0bccad3a0967" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-fb6325f5-75be-4e2f-923e-0bccad3a0967" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Deleting offline snapshot fb6325f5-75be-4e2f-923e-0bccad3a0967 of volume 21f2f882-2bee-4f77-a348-861b3fc9a13a {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] snapshot_file for this snap is: volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:35:55 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1c8dff7c-c335-4739-b351-2b5f5d7ae33a" returned: 0 in 0.310s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f157185-c434-455a-a9a9-e82b4e7c6ca8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-quobyte-1c8dff7c-c335-4739-b351-2b5f5d7ae33a" released by "delete_volume" :: held 0.962s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Created reservations ['22cf43ee-6031-40c7-9e42-4e2af4cc773e', 'c6938382-577b-45e5-9a2a-f7b7170c1bb6', '251fdf19-e741-4600-9405-e214e267a6d1', '425f8a81-80c9-4a6b-8055-d7a6129e0d08'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:55 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d" returned: 0 in 0.394s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90198629-52f9-4d39-b5aa-af2a0bf2c734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c54739-5db8-47ec-afd8-3ea9063cce7d', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541af8b7-c135-418c-88e5-de692df74712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:35:55 devstack sudo[108410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967
Sep 29 18:35:55 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:55 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Volume volume-18c54739-5db8-47ec-afd8-3ea9063cce7d (18c54739-5db8-47ec-afd8-3ea9063cce7d): created successfully
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541af8b7-c135-418c-88e5-de692df74712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:35:55 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Flow 'volume_create_manager' (c6c2105a-2a1b-4c2e-a7ae-b3277c0d0cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:35:56 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:56 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:56 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-40f62cb4-4317-4aee-a539-955043e3499a tempest-ProjectReaderTests-1134823584 None] Created volume successfully.
Sep 29 18:35:56 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967" returned: 0 in 0.518s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21f2f882-2bee-4f77-a348-861b3fc9a13a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d0e193-f854-422a-a4e5-3ef1ba371019]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:56 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.353s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:56 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Deleted volume successfully.
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-c6c6382d-f674-4fc0-bf74-e637bc159737 tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-1c8dff7c-c335-4739-b351-2b5f5d7ae33a-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:56 devstack sudo[108420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a
Sep 29 18:35:56 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] Creating offline snapshot 7aa569cc-ede4-480a-b4de-8442f04a6037 of volume 18c54739-5db8-47ec-afd8-3ea9063cce7d {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:35:56 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5b2481-950a-4919-8974-0537d1c4dc43]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a" returned: 0 in 0.467s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:56 devstack sudo[108427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967
Sep 29 18:35:56 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:56 devstack sudo[108426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d
Sep 29 18:35:56 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "cinder-5597be2e-912f-4115-94a9-04c226ea66a9-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-5597be2e-912f-4115-94a9-04c226ea66a9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "cinder-quobyte-5597be2e-912f-4115-94a9-04c226ea66a9" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-quobyte-5597be2e-912f-4115-94a9-04c226ea66a9" acquired by "delete_volume" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6af20fc-c48f-4d6e-b174-945a8487ee20]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:57 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d" returned: 0 in 0.468s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:57 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967" returned: 0 in 0.478s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:57 devstack sudo[108438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037 1G
Sep 29 18:35:57 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:57 devstack sudo[108439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967
Sep 29 18:35:57 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:57 devstack sudo[108437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9
Sep 29 18:35:57 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:57 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a.fb6325f5-75be-4e2f-923e-0bccad3a0967" returned: 0 in 0.296s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-fb6325f5-75be-4e2f-923e-0bccad3a0967" released by "_delete_snapshot" :: held 1.921s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-21f2f882-2bee-4f77-a348-861b3fc9a13a" released by "delete_snapshot" :: held 1.962s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Created reservations ['37656c1d-b008-4098-8002-bb8381deb40c', 'e567b9af-565e-4f55-af61-c7621b0977e8', '52b3a10d-cd6a-479e-bbb6-6f86f1b234ac', 'aa02639e-8f4e-4822-89e3-3b21b6082fc3'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:57 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9" returned: 0 in 0.570s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:57 devstack sudo[108451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9
Sep 29 18:35:57 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Delete snapshot completed successfully.
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-cc85454d-c5f4-4fee-85a5-6e4b4c0e40c4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-fb6325f5-75be-4e2f-923e-0bccad3a0967-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:57 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037 1G" returned: 0 in 0.583s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c54739-5db8-47ec-afd8-3ea9063cce7d -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:57 devstack sudo[108453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c54739-5db8-47ec-afd8-3ea9063cce7d -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037
Sep 29 18:35:57 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:58 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-5597be2e-912f-4115-94a9-04c226ea66a9" returned: 0 in 0.296s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-quobyte-5597be2e-912f-4115-94a9-04c226ea66a9" released by "delete_volume" :: held 0.921s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Created reservations ['65b9dbda-cf06-4b59-9427-faf13c86fc09', '8685797f-9d1e-4cbf-859d-f2298db30326', '387a13d9-6f0e-4084-855d-733d0ed1c9c0', '8b6429ee-9766-439a-8259-c46845c73da2'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:58 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c54739-5db8-47ec-afd8-3ea9063cce7d -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037" returned: 0 in 0.330s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:58 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037 is being set with open permissions: ugo+rw
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:58 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037
Sep 29 18:35:58 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:58 devstack sudo[108461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:58 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:58 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037" returned: 0 in 0.344s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:58 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.317s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:35:58 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Deleted volume successfully.
Sep 29 18:35:58 devstack sudo[108465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.info
Sep 29 18:35:58 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8612f0f1-ffa7-4dde-8f3b-c0b85753df3e tempest-CinderUnicodeTest-1217294757 None] Lock "cinder-5597be2e-912f-4115-94a9-04c226ea66a9-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:58 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.info" returned: 0 in 0.295s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:58 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.info is being set with open permissions: ugo+rw
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-21f2f882-2bee-4f77-a348-861b3fc9a13a-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:58 devstack sudo[108468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.info
Sep 29 18:35:58 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Lock "cinder-21f2f882-2bee-4f77-a348-861b3fc9a13a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-21f2f882-2bee-4f77-a348-861b3fc9a13a" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-21f2f882-2bee-4f77-a348-861b3fc9a13a" acquired by "delete_volume" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80d0b97-a111-4b6c-b6e1-bad211e3fbe6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:35:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:59 devstack sudo[108470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a
Sep 29 18:35:59 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:59 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.info" returned: 0 in 0.310s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:59 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8c65846e-fa67-4fbd-82e1-336d8c1aa983 tempest-ProjectReaderTests-1134823584 None] Create snapshot completed successfully
Sep 29 18:35:59 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a" returned: 0 in 0.405s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:59 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a
Sep 29 18:35:59 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:59 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f2f882-2bee-4f77-a348-861b3fc9a13a" returned: 0 in 0.251s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-21f2f882-2bee-4f77-a348-861b3fc9a13a" released by "delete_volume" :: held 0.732s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Created reservations ['2cac6f61-1a82-41ef-bf8e-c525cc8ed298', 'dc8e1900-ee13-4a14-89ae-bf4a712c7679', 'ae9ff1f1-fedb-446e-9ab5-2e27e8190192', '8a8df888-3c9a-4c64-9d10-b74f85422440'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:35:59 devstack sudo[108480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:35:59 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:35:59 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-7aa569cc-ede4-480a-b4de-8442f04a6037-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-7aa569cc-ede4-480a-b4de-8442f04a6037-delete_snapshot" acquired by "delete_snapshot" :: waited 0.095s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-18c54739-5db8-47ec-afd8-3ea9063cce7d" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-18c54739-5db8-47ec-afd8-3ea9063cce7d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-7aa569cc-ede4-480a-b4de-8442f04a6037" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:00 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-7aa569cc-ede4-480a-b4de-8442f04a6037" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Deleting offline snapshot 7aa569cc-ede4-480a-b4de-8442f04a6037 of volume 18c54739-5db8-47ec-afd8-3ea9063cce7d {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] snapshot_file for this snap is: volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.332s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:36:00 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Deleted volume successfully.
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5109f22c-be33-4cea-8f21-8f5d77ff6eab]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bfca90de-9a38-4fda-b250-a56ec799d0d5 tempest-ProjectMemberTests-918657444 None] Lock "cinder-21f2f882-2bee-4f77-a348-861b3fc9a13a-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:00 devstack sudo[108483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037
Sep 29 18:36:00 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:00 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037" returned: 0 in 0.466s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18c54739-5db8-47ec-afd8-3ea9063cce7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f98f842-4ca4-4ee8-8dcd-9504803d5746]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (81db9011-0d09-420a-b1d2-9c0642e8b850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6664c395-125b-4835-8831-fac798207416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6664c395-125b-4835-8831-fac798207416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739932997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a925c550-62af-4fbc-8834-fab639616232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:01Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b00df00-1b98-45cb-b36e-22387cbbd1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b00df00-1b98-45cb-b36e-22387cbbd1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd3edfc-7e55-46f8-8084-15791398a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd3edfc-7e55-46f8-8084-15791398a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a925c550-62af-4fbc-8834-fab639616232', 'volume_name': 'volume-a925c550-62af-4fbc-8834-fab639616232', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf13f4ac-9b08-470b-8dac-0e67f51f86fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf13f4ac-9b08-470b-8dac-0e67f51f86fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:00 devstack sudo[108488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d
Sep 29 18:36:00 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed41f3af-f9c7-447e-b50b-a505ec06e4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:00 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Volume a925c550-62af-4fbc-8834-fab639616232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a925c550-62af-4fbc-8834-fab639616232', 'volume_size': 1}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739932997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a925c550-62af-4fbc-8834-fab639616232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:01Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Creating volume a925c550-62af-4fbc-8834-fab639616232 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:36:00 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:36:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:00 devstack sudo[108490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232 1073741824
Sep 29 18:36:00 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:01 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d" returned: 0 in 0.395s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:01 devstack sudo[108499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037
Sep 29 18:36:01 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:01 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232 1073741824" returned: 0 in 0.481s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:01 devstack sudo[108504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232
Sep 29 18:36:01 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:01 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037" returned: 0 in 0.411s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:01 devstack sudo[108508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037
Sep 29 18:36:01 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:01 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232" returned: 0 in 0.302s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed41f3af-f9c7-447e-b50b-a505ec06e4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a925c550-62af-4fbc-8834-fab639616232', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffee40e-b12e-4eeb-b311-8ca7567ab9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:01 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Volume volume-a925c550-62af-4fbc-8834-fab639616232 (a925c550-62af-4fbc-8834-fab639616232): created successfully
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffee40e-b12e-4eeb-b311-8ca7567ab9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (81db9011-0d09-420a-b1d2-9c0642e8b850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:01 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-e0c6e1fa-0151-492f-a3b1-8e3d16392457 tempest-ProjectMemberTests-918657444 None] Created volume successfully.
Sep 29 18:36:01 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d.7aa569cc-ede4-480a-b4de-8442f04a6037" returned: 0 in 0.304s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-7aa569cc-ede4-480a-b4de-8442f04a6037" released by "_delete_snapshot" :: held 1.717s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-18c54739-5db8-47ec-afd8-3ea9063cce7d" released by "delete_snapshot" :: held 1.744s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Created reservations ['c365348f-b5b9-4b31-942f-72fa6a4f7f47', 'fde83231-8447-4d10-aaee-39483a155049', '8f6c7c5b-ef21-4a25-af37-d9c3fddd756e', 'a82669aa-2fe0-4491-9be2-e6a2040d836e'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6c7c39e8-d7ff-4176-b5be-6362973391f4 tempest-ProjectAdminTests-2074642831 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.014518737793, 'free_capacity_gb': 1775.014518737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86821) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 29 18:36:01 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Delete snapshot completed successfully.
Sep 29 18:36:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a49f74f2-8adb-4e44-aa46-481056fce2d8 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-7aa569cc-ede4-480a-b4de-8442f04a6037-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-18c54739-5db8-47ec-afd8-3ea9063cce7d-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-18c54739-5db8-47ec-afd8-3ea9063cce7d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-18c54739-5db8-47ec-afd8-3ea9063cce7d" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-18c54739-5db8-47ec-afd8-3ea9063cce7d" acquired by "delete_volume" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[50258751-bd5e-4ad8-8891-f3187deda559]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:02 devstack sudo[108512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d
Sep 29 18:36:02 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:02 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d" returned: 0 in 0.415s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:02 devstack sudo[108517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d
Sep 29 18:36:02 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] Creating offline snapshot 9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed of volume a925c550-62af-4fbc-8834-fab639616232 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9c4bba-7ec8-404a-89f1-f3bf76151c57]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:03 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-18c54739-5db8-47ec-afd8-3ea9063cce7d" returned: 0 in 0.341s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-18c54739-5db8-47ec-afd8-3ea9063cce7d" released by "delete_volume" :: held 0.836s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:03 devstack sudo[108519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232
Sep 29 18:36:03 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Created reservations ['e6211a9a-e609-402d-945c-d7b0eae08f65', '695b6f77-eed7-4b61-b923-228b1332f357', '38534867-f4a2-4c3c-b8b7-11b2286d7f57', 'a0ff0103-b0c0-447e-bac8-e45c4816910d'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:03 devstack sudo[108522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:36:03 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:03 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232" returned: 0 in 0.469s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:03 devstack sudo[108528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed 1G
Sep 29 18:36:03 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:03 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.321s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:36:03 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Deleted volume successfully.
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-7d8a9a65-44c5-4cd3-af64-6bae15f82624 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-18c54739-5db8-47ec-afd8-3ea9063cce7d-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Flow 'volume_create_manager' (f49fccf7-cf04-4b6c-b3c6-8f9ad2120be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393b218b-5e33-4a97-8966-31ad78babb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393b218b-5e33-4a97-8966-31ad78babb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509870693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb0222a-ffc5-4ec6-bc6a-24764dbee030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd0b7eaf3f4870a782b6617e6a4eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:04Z,use_quota=True,user_id='932584dc1cf848da80a0b5783fbc7089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74870ec5-97df-496f-945e-16faf35860fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74870ec5-97df-496f-945e-16faf35860fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c8a57d-04a6-4e0b-ac5e-9bc0b4905a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c8a57d-04a6-4e0b-ac5e-9bc0b4905a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb0222a-ffc5-4ec6-bc6a-24764dbee030', 'volume_name': 'volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5b1c08-3e76-4e91-8eb6-e35a315e462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5b1c08-3e76-4e91-8eb6-e35a315e462d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4fd6c0-67bd-4a26-96ee-3f7ecdbdc3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:03 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Volume ecb0222a-ffc5-4ec6-bc6a-24764dbee030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030', 'volume_size': 1}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:03 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed 1G" returned: 0 in 0.560s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a925c550-62af-4fbc-8834-fab639616232 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:04 devstack sudo[108535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a925c550-62af-4fbc-8834-fab639616232 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed
Sep 29 18:36:04 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:04 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a925c550-62af-4fbc-8834-fab639616232 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed" returned: 0 in 0.309s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:04 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed is being set with open permissions: ugo+rw
Sep 29 18:36:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:04 devstack sudo[108541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed
Sep 29 18:36:04 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:04 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed" returned: 0 in 0.248s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:04 devstack sudo[108544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.info
Sep 29 18:36:04 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:04 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.info" returned: 0 in 0.287s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:04 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.info is being set with open permissions: ugo+rw
Sep 29 18:36:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:04 devstack sudo[108547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.info
Sep 29 18:36:04 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:05 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.info" returned: 0 in 0.249s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509870693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb0222a-ffc5-4ec6-bc6a-24764dbee030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd0b7eaf3f4870a782b6617e6a4eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:04Z,use_quota=True,user_id='932584dc1cf848da80a0b5783fbc7089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Creating volume ecb0222a-ffc5-4ec6-bc6a-24764dbee030 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:36:05 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:05 devstack sudo[108550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 1073741824
Sep 29 18:36:05 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-324ea853-4c91-42d9-8e61-1d5e87ca0032 tempest-ProjectMemberTests-918657444 None] Create snapshot completed successfully
Sep 29 18:36:05 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 1073741824" returned: 0 in 0.460s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:05 devstack sudo[108556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030
Sep 29 18:36:05 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:05 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030" returned: 0 in 0.253s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4fd6c0-67bd-4a26-96ee-3f7ecdbdc3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b67e31-1a58-4e5d-ad37-76490d2b7fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:05 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Volume volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 (ecb0222a-ffc5-4ec6-bc6a-24764dbee030): created successfully
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b67e31-1a58-4e5d-ad37-76490d2b7fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Flow 'volume_create_manager' (f49fccf7-cf04-4b6c-b3c6-8f9ad2120be2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-28493134-b53a-45e5-af0d-ffb5c8abcf2b tempest-ProjectReaderTests-1134823584 None] Created volume successfully.
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Lock "cinder-9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-a925c550-62af-4fbc-8834-fab639616232" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-a925c550-62af-4fbc-8834-fab639616232" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Deleting offline snapshot 9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed of volume a925c550-62af-4fbc-8834-fab639616232 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] snapshot_file for this snap is: volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c02706-e4a9-4d7f-ae03-749555199ba9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:06 devstack sudo[108559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed
Sep 29 18:36:06 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:06 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed" returned: 0 in 0.380s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a925c550-62af-4fbc-8834-fab639616232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bd944c-b3cb-4d2d-ad55-87c543d06228]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:06 devstack sudo[108567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232
Sep 29 18:36:06 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:07 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232" returned: 0 in 0.403s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:07 devstack sudo[108572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed
Sep 29 18:36:07 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] Creating offline snapshot 1cc98121-9c29-4f46-bebf-762b6d7cf330 of volume ecb0222a-ffc5-4ec6-bc6a-24764dbee030 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3851c610-94c0-4310-95e4-9b8ad1fd7eb6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:07 devstack sudo[108577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030
Sep 29 18:36:07 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:07 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed" returned: 0 in 0.444s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:07 devstack sudo[108579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed
Sep 29 18:36:07 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:07 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030" returned: 0 in 0.455s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:07 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232.9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed" returned: 0 in 0.305s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:07 devstack sudo[108585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330 1G
Sep 29 18:36:07 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed" released by "_delete_snapshot" :: held 1.655s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-a925c550-62af-4fbc-8834-fab639616232" released by "delete_snapshot" :: held 1.682s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Created reservations ['369b54ee-e0d6-47bd-9f93-696c3e8a0583', '97bd17c5-2855-4050-80a3-ed9e43377c5c', '3381b548-bc65-4ae9-a9f1-86167007d8b4', '9a7b1516-2c1e-46d6-8e3e-2a2526306997'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:07 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Delete snapshot completed successfully.
Sep 29 18:36:07 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-50d6b51a-2ae2-4d1f-a7e1-bb7121e121e1 tempest-ProjectMemberTests-918657444 None] Lock "cinder-9c6e1473-0ac5-4a06-9a0f-3f01e82c53ed-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:08 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330 1G" returned: 0 in 0.525s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:08 devstack sudo[108591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330
Sep 29 18:36:08 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-a925c550-62af-4fbc-8834-fab639616232-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Lock "cinder-a925c550-62af-4fbc-8834-fab639616232-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-a925c550-62af-4fbc-8834-fab639616232" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-a925c550-62af-4fbc-8834-fab639616232" acquired by "delete_volume" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19574e9-9547-4973-af82-7cbff595be08]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:08 devstack sudo[108593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232
Sep 29 18:36:08 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:08 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330" returned: 0 in 0.397s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:08 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330 is being set with open permissions: ugo+rw
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:08 devstack sudo[108598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330
Sep 29 18:36:08 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:08 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232" returned: 0 in 0.413s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:08 devstack sudo[108603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232
Sep 29 18:36:08 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:08 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:08 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330" returned: 0 in 0.272s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:09 devstack sudo[108606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.info
Sep 29 18:36:09 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:09 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a925c550-62af-4fbc-8834-fab639616232" returned: 0 in 0.287s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-a925c550-62af-4fbc-8834-fab639616232" released by "delete_volume" :: held 0.793s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:09 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.info" returned: 0 in 0.268s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:09 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.info is being set with open permissions: ugo+rw
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:09 devstack sudo[108610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.info
Sep 29 18:36:09 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Created reservations ['8c206b03-30e4-4219-9827-eff94988bdcb', '0c43a887-8bd2-459a-ad2d-7935d78dece6', '818e380b-05e5-4ca2-b8a6-093658062301', 'd42e48e4-ebbf-4303-816e-01e3672d4041'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:09 devstack sudo[108612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:36:09 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:09 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.info" returned: 0 in 0.288s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:09 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-96c3dbc8-9d6b-4bd1-9e2a-0e12361f0150 tempest-ProjectReaderTests-1134823584 None] Create snapshot completed successfully
Sep 29 18:36:09 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.353s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:36:09 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Deleted volume successfully.
Sep 29 18:36:09 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-f0df1cfc-fc4e-4a71-bd8a-a32a1c6335e5 tempest-ProjectMemberTests-918657444 None] Lock "cinder-a925c550-62af-4fbc-8834-fab639616232-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (5c891351-73f5-4568-8d8b-486b9254b63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd470b37-3b1d-4e64-a151-8976e385a220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd470b37-3b1d-4e64-a151-8976e385a220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561347973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd4a1c8-493a-42bf-8ea7-e85a44cf374a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:10Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a54500-63af-4dc4-8332-032368e10882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a54500-63af-4dc4-8332-032368e10882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304978ae-48c0-4a89-943f-6c88c81694f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304978ae-48c0-4a89-943f-6c88c81694f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd4a1c8-493a-42bf-8ea7-e85a44cf374a', 'volume_name': 'volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba482d7-752c-40f5-95a1-553508436c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba482d7-752c-40f5-95a1-553508436c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c510657d-63af-4817-8907-725c90bef6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:10 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Volume 2fd4a1c8-493a-42bf-8ea7-e85a44cf374a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a', 'volume_size': 1}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561347973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd4a1c8-493a-42bf-8ea7-e85a44cf374a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:10Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Creating volume 2fd4a1c8-493a-42bf-8ea7-e85a44cf374a {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:36:10 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:10 devstack sudo[108616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a 1073741824
Sep 29 18:36:10 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-1cc98121-9c29-4f46-bebf-762b6d7cf330-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-1cc98121-9c29-4f46-bebf-762b6d7cf330-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-ecb0222a-ffc5-4ec6-bc6a-24764dbee030" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-ecb0222a-ffc5-4ec6-bc6a-24764dbee030" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-1cc98121-9c29-4f46-bebf-762b6d7cf330" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-1cc98121-9c29-4f46-bebf-762b6d7cf330" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Deleting offline snapshot 1cc98121-9c29-4f46-bebf-762b6d7cf330 of volume ecb0222a-ffc5-4ec6-bc6a-24764dbee030 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] snapshot_file for this snap is: volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[932093bc-8a0d-4934-9a51-1f054484a366]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:10 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a 1073741824" returned: 0 in 0.535s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:10 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:10 devstack sudo[108622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330
Sep 29 18:36:10 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:10 devstack sudo[108623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a
Sep 29 18:36:10 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:11 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a" returned: 0 in 0.285s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c510657d-63af-4817-8907-725c90bef6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd591cb5-e300-40c6-acef-af57bda51ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:11 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Volume volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a (2fd4a1c8-493a-42bf-8ea7-e85a44cf374a): created successfully
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd591cb5-e300-40c6-acef-af57bda51ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:11 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (5c891351-73f5-4568-8d8b-486b9254b63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330" returned: 0 in 0.439s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:36:11 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-f14d0f64-84a9-402b-8f3d-78b4980c51f7 tempest-ProjectMemberTests-918657444 None] Created volume successfully.
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c932ee0c-de2d-40dd-a8db-62b6126617e7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:11 devstack sudo[108631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030
Sep 29 18:36:11 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:11 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030" returned: 0 in 0.371s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:11 devstack sudo[108636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330
Sep 29 18:36:11 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:11 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330" returned: 0 in 0.358s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:11 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:11 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330
Sep 29 18:36:11 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:12 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030.1cc98121-9c29-4f46-bebf-762b6d7cf330" returned: 0 in 0.275s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-1cc98121-9c29-4f46-bebf-762b6d7cf330" released by "_delete_snapshot" :: held 1.559s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-ecb0222a-ffc5-4ec6-bc6a-24764dbee030" released by "delete_snapshot" :: held 1.592s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Created reservations ['325dc8f7-2da0-45f8-af34-0c0b7db40a83', '7a1bc041-6b00-4293-9e50-367777f5239c', '78e93891-1ddb-4f09-a6de-350da784cca3', '9b0f4611-b98c-4672-b1bd-42c2d2708716'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:12 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Delete snapshot completed successfully.
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0f3e0519-0ac9-48b6-bfdf-616fa960f043 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-1cc98121-9c29-4f46-bebf-762b6d7cf330-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] Creating offline snapshot 51e31852-ea11-48ba-804b-3f37566acd4d of volume 2fd4a1c8-493a-42bf-8ea7-e85a44cf374a {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0b3734-5c48-4d6f-8058-3d28e5a05de1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:12 devstack sudo[108644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a
Sep 29 18:36:12 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-ecb0222a-ffc5-4ec6-bc6a-24764dbee030-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-ecb0222a-ffc5-4ec6-bc6a-24764dbee030-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-ecb0222a-ffc5-4ec6-bc6a-24764dbee030" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-ecb0222a-ffc5-4ec6-bc6a-24764dbee030" acquired by "delete_volume" :: waited 0.014s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:12 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[800b1e54-9b3b-4e83-b9d2-eec46e9d3f82]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a" returned: 0 in 0.446s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:12 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:12 devstack sudo[108650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d 1G
Sep 29 18:36:12 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:12 devstack sudo[108649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030
Sep 29 18:36:12 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:13 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030" returned: 0 in 0.403s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:13 devstack sudo[108661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030
Sep 29 18:36:13 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:13 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d 1G" returned: 0 in 0.488s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:13 devstack sudo[108664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d
Sep 29 18:36:13 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:13 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ecb0222a-ffc5-4ec6-bc6a-24764dbee030" returned: 0 in 0.276s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-ecb0222a-ffc5-4ec6-bc6a-24764dbee030" released by "delete_volume" :: held 0.758s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Created reservations ['2ad25395-aed3-4834-a41d-23c984a74333', '8f14aaba-f0d4-4044-88de-abfb70a2cb89', 'e7b97a7c-d4fa-4707-bfe6-ff7a33445511', '47428b79-9ff5-4aae-b033-8636124aacb9'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:13 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d" returned: 0 in 0.340s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:13 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d is being set with open permissions: ugo+rw
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:13 devstack sudo[108671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:36:13 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:13 devstack sudo[108672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d
Sep 29 18:36:13 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:13 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.262s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:36:13 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Deleted volume successfully.
Sep 29 18:36:13 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d" returned: 0 in 0.278s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8445e551-c071-44d1-a7c3-a2df8b131e23 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-ecb0222a-ffc5-4ec6-bc6a-24764dbee030-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:13 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:14 devstack sudo[108677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.info
Sep 29 18:36:14 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:14 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.info" returned: 0 in 0.290s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:14 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.info is being set with open permissions: ugo+rw
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:14 devstack sudo[108680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.info
Sep 29 18:36:14 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Flow 'volume_create_manager' (8b922fd3-5fa7-4557-b9b1-387080a5d27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4507312c-22fb-4ffc-9d42-3e4c7203c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4507312c-22fb-4ffc-9d42-3e4c7203c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086146039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1100a988-e4e5-4164-8971-2c9695c4d688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd0b7eaf3f4870a782b6617e6a4eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:14Z,use_quota=True,user_id='932584dc1cf848da80a0b5783fbc7089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa058d88-0b49-47e9-b578-c97a8e500637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa058d88-0b49-47e9-b578-c97a8e500637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9990e0f6-27a1-43a3-872b-12a70a0c65ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9990e0f6-27a1-43a3-872b-12a70a0c65ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1100a988-e4e5-4164-8971-2c9695c4d688', 'volume_name': 'volume-1100a988-e4e5-4164-8971-2c9695c4d688', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4839017b-80f3-4861-a94c-b59e5f67b8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4839017b-80f3-4861-a94c-b59e5f67b8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86eace66-c50f-4cdc-8474-91ad01b6140c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:14 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Volume 1100a988-e4e5-4164-8971-2c9695c4d688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1100a988-e4e5-4164-8971-2c9695c4d688', 'volume_size': 1}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:14 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.info" returned: 0 in 0.278s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.230s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.087s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086146039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1100a988-e4e5-4164-8971-2c9695c4d688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='effd0b7eaf3f4870a782b6617e6a4eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:14Z,use_quota=True,user_id='932584dc1cf848da80a0b5783fbc7089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Creating volume 1100a988-e4e5-4164-8971-2c9695c4d688 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:36:14 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:36:14 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:14 devstack sudo[108683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688 1073741824
Sep 29 18:36:14 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:14 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-7e129c03-0969-48d8-921b-1be1ec6ba2da tempest-ProjectMemberTests-918657444 None] Create snapshot completed successfully
Sep 29 18:36:15 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688 1073741824" returned: 0 in 0.455s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:15 devstack sudo[108689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688
Sep 29 18:36:15 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:15 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688" returned: 0 in 0.240s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86eace66-c50f-4cdc-8474-91ad01b6140c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1100a988-e4e5-4164-8971-2c9695c4d688', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fc66b6-3d5d-48ca-8650-8555b6d6be85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:15 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Volume volume-1100a988-e4e5-4164-8971-2c9695c4d688 (1100a988-e4e5-4164-8971-2c9695c4d688): created successfully
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fc66b6-3d5d-48ca-8650-8555b6d6be85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Flow 'volume_create_manager' (8b922fd3-5fa7-4557-b9b1-387080a5d27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:15 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-fce6ff43-3721-461b-95ca-35092326ceb6 tempest-ProjectReaderTests-1134823584 None] Created volume successfully.
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-51e31852-ea11-48ba-804b-3f37566acd4d-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-51e31852-ea11-48ba-804b-3f37566acd4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-51e31852-ea11-48ba-804b-3f37566acd4d" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-51e31852-ea11-48ba-804b-3f37566acd4d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Deleting offline snapshot 51e31852-ea11-48ba-804b-3f37566acd4d of volume 2fd4a1c8-493a-42bf-8ea7-e85a44cf374a {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] snapshot_file for this snap is: volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[915359d8-8731-464e-9fe5-b44a6e33266b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:15 devstack sudo[108692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d
Sep 29 18:36:15 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:15 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d" returned: 0 in 0.357s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:15 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:36:16 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9013ad83-8c51-4c95-9241-66ba48e74717]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:16 devstack sudo[108697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a
Sep 29 18:36:16 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:16 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a" returned: 0 in 0.418s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:16 devstack sudo[108702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d
Sep 29 18:36:16 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:16 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] Creating offline snapshot 08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 of volume 1100a988-e4e5-4164-8971-2c9695c4d688 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:36:16 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[83669277-406f-41ef-9110-a8013981f968]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:16 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:16 devstack sudo[108707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688
Sep 29 18:36:16 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d" returned: 0 in 0.420s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:16 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:16 devstack sudo[108709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d
Sep 29 18:36:16 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:17 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688" returned: 0 in 0.391s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:17 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a.51e31852-ea11-48ba-804b-3f37566acd4d" returned: 0 in 0.277s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:17 devstack sudo[108716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 1G
Sep 29 18:36:17 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-51e31852-ea11-48ba-804b-3f37566acd4d" released by "_delete_snapshot" :: held 1.589s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a" released by "delete_snapshot" :: held 1.613s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Created reservations ['cfb4123a-fb45-4de4-86e1-e2c6031dcba3', 'c9cc965e-4d97-4d3e-978e-951b2ba133d3', '7755aee0-c709-4829-ac6a-04ec8a69623b', 'ab334625-8c2f-47c3-82b4-b331ee9a9f60'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:17 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Delete snapshot completed successfully.
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-36a2cc68-2111-4be1-9df7-c68986e034e4 tempest-ProjectMemberTests-918657444 None] Lock "cinder-51e31852-ea11-48ba-804b-3f37566acd4d-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:17 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 1G" returned: 0 in 0.467s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1100a988-e4e5-4164-8971-2c9695c4d688 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:17 devstack sudo[108722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1100a988-e4e5-4164-8971-2c9695c4d688 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4
Sep 29 18:36:17 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Lock "cinder-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb960da-919d-404c-844a-bd45cad835a1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:17 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1100a988-e4e5-4164-8971-2c9695c4d688 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4" returned: 0 in 0.369s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:17 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 is being set with open permissions: ugo+rw
Sep 29 18:36:17 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:17 devstack sudo[108728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4
Sep 29 18:36:17 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:18 devstack sudo[108727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a
Sep 29 18:36:18 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:18 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4" returned: 0 in 0.355s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:18 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a" returned: 0 in 0.496s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:18 devstack sudo[108736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.info
Sep 29 18:36:18 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:18 devstack sudo[108738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a
Sep 29 18:36:18 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:18 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.info" returned: 0 in 0.268s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:18 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.info is being set with open permissions: ugo+rw
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:18 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a" returned: 0 in 0.257s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:18 devstack sudo[108742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.info
Sep 29 18:36:18 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a" released by "delete_volume" :: held 0.835s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Created reservations ['52258b89-8489-4f55-90ee-834971f874f1', '01bf1d2f-9ef8-4220-819f-c8caa0b1da2c', '7d3f79dd-ab86-4504-838d-be683becd40d', '114c2500-002d-4afd-9046-9bad39cc2410'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:18 devstack sudo[108744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:36:18 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:18 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.info" returned: 0 in 0.286s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:18 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:18 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-53ed43c9-bd57-4bb5-9b80-21910d310730 tempest-ProjectReaderTests-1134823584 None] Create snapshot completed successfully
Sep 29 18:36:19 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.253s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:36:19 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Deleted volume successfully.
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3777ec5e-e915-452b-b942-0caf3064754b tempest-ProjectMemberTests-918657444 None] Lock "cinder-2fd4a1c8-493a-42bf-8ea7-e85a44cf374a-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (d68bb193-74a3-4f43-9b8b-c7a26f0b868a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f273af7-0584-488f-af94-259ef7708056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f273af7-0584-488f-af94-259ef7708056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776527559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dd2092-850d-4252-a4ea-96ed0237c504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:19Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53294f9-dc66-49c7-a0f0-55924cfb0e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53294f9-dc66-49c7-a0f0-55924cfb0e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3893fe27-80b5-44b6-af64-7b3bd6828e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3893fe27-80b5-44b6-af64-7b3bd6828e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6dd2092-850d-4252-a4ea-96ed0237c504', 'volume_name': 'volume-b6dd2092-850d-4252-a4ea-96ed0237c504', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cab91e5-af82-491a-a182-d8813a490fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cab91e5-af82-491a-a182-d8813a490fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66450dc-20cb-4ca5-8c55-b4a23eaec135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:19 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Volume b6dd2092-850d-4252-a4ea-96ed0237c504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6dd2092-850d-4252-a4ea-96ed0237c504', 'volume_size': 1}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776527559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dd2092-850d-4252-a4ea-96ed0237c504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:19Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Creating volume b6dd2092-850d-4252-a4ea-96ed0237c504 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:36:19 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:19 devstack sudo[108748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504 1073741824
Sep 29 18:36:19 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Lock "cinder-08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-1100a988-e4e5-4164-8971-2c9695c4d688" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:19 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504 1073741824" returned: 0 in 0.431s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-1100a988-e4e5-4164-8971-2c9695c4d688" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Deleting offline snapshot 08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 of volume 1100a988-e4e5-4164-8971-2c9695c4d688 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] snapshot_file for this snap is: volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0173f6f3-90e7-4b92-96c6-695c94d222a1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:19 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:19 devstack sudo[108754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504
Sep 29 18:36:19 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:20 devstack sudo[108755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4
Sep 29 18:36:20 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:20 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504" returned: 0 in 0.250s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66450dc-20cb-4ca5-8c55-b4a23eaec135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6dd2092-850d-4252-a4ea-96ed0237c504', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5732cb4d-5cc8-4cb4-b00b-b28529b2d57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:20 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Volume volume-b6dd2092-850d-4252-a4ea-96ed0237c504 (b6dd2092-850d-4252-a4ea-96ed0237c504): created successfully
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5732cb4d-5cc8-4cb4-b00b-b28529b2d57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (d68bb193-74a3-4f43-9b8b-c7a26f0b868a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:20 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2caa37c5-2de7-401f-b3e1-a5d35fb22437 tempest-ProjectMemberTests-918657444 None] Created volume successfully.
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4" returned: 0 in 0.409s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1100a988-e4e5-4164-8971-2c9695c4d688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:36:20 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83028c5-614e-41fa-8311-13d94dfe7810]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:20 devstack sudo[108762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688
Sep 29 18:36:20 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] Creating offline snapshot fd3ca322-4590-4527-8455-444b3c2982af of volume b6dd2092-850d-4252-a4ea-96ed0237c504 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[170af6d8-8d8b-4c30-ad2d-45891d25d0a2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:20 devstack sudo[108764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504
Sep 29 18:36:20 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:20 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688" returned: 0 in 0.400s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:20 devstack sudo[108769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4
Sep 29 18:36:20 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:20 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504" returned: 0 in 0.371s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:20 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:21 devstack sudo[108774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af 1G
Sep 29 18:36:21 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:21 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4" returned: 0 in 0.337s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:21 devstack sudo[108779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4
Sep 29 18:36:21 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:21 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688.08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4" returned: 0 in 0.260s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:21 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af 1G" returned: 0 in 0.440s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dd2092-850d-4252-a4ea-96ed0237c504 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4" released by "_delete_snapshot" :: held 1.532s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-1100a988-e4e5-4164-8971-2c9695c4d688" released by "delete_snapshot" :: held 1.558s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:21 devstack sudo[108785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dd2092-850d-4252-a4ea-96ed0237c504 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af
Sep 29 18:36:21 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Created reservations ['3542736e-0769-402d-a659-045e5d38fbad', '51c8987f-e579-42b8-961d-478644b1946f', '449fc7f9-c87c-41c2-88d2-bd33ef2367a3', '07115496-0527-4966-9f6b-ce5de77f4440'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:21 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Delete snapshot completed successfully.
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-38b836bb-efb1-4cce-8b0c-73f07b79351d tempest-ProjectReaderTests-1134823584 None] Lock "cinder-08eab969-7f7b-4b5a-91f8-3b05c9dd1ea4-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:21 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dd2092-850d-4252-a4ea-96ed0237c504 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af" returned: 0 in 0.297s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:21 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af is being set with open permissions: ugo+rw
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:21 devstack sudo[108790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af
Sep 29 18:36:21 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:21 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af" returned: 0 in 0.226s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=211,cinder:INSERT=80,cinder:UPDATE=259,cinder:DELETE=24 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=196,cinder:INSERT=62,cinder:UPDATE=261,cinder:DELETE=18 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:36:21 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:22 devstack sudo[108793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.info
Sep 29 18:36:22 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-1100a988-e4e5-4164-8971-2c9695c4d688-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-1100a988-e4e5-4164-8971-2c9695c4d688-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "cinder-quobyte-1100a988-e4e5-4164-8971-2c9695c4d688" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-1100a988-e4e5-4164-8971-2c9695c4d688" acquired by "delete_volume" :: waited 0.014s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a06e49-9a1a-41f1-8f18-67e522ac9f6f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:22 devstack sudo[108795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688
Sep 29 18:36:22 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:22 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.info" returned: 0 in 0.272s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:22 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.info is being set with open permissions: ugo+rw
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:22 devstack sudo[108798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.info
Sep 29 18:36:22 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:22 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.info" returned: 0 in 0.245s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:22 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688" returned: 0 in 0.389s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:22 devstack sudo[108804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688
Sep 29 18:36:22 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:22 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-c22adf6c-4b15-4921-b4d3-116e1fa15503 tempest-ProjectMemberTests-918657444 None] Create snapshot completed successfully
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-fd3ca322-4590-4527-8455-444b3c2982af-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Lock "cinder-fd3ca322-4590-4527-8455-444b3c2982af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-b6dd2092-850d-4252-a4ea-96ed0237c504" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b6dd2092-850d-4252-a4ea-96ed0237c504" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-fd3ca322-4590-4527-8455-444b3c2982af" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-fd3ca322-4590-4527-8455-444b3c2982af" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Deleting offline snapshot fd3ca322-4590-4527-8455-444b3c2982af of volume b6dd2092-850d-4252-a4ea-96ed0237c504 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] snapshot_file for this snap is: volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:36:22 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-1100a988-e4e5-4164-8971-2c9695c4d688" returned: 0 in 0.288s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b1d249-46ce-4e16-891b-b3c3fbbdc73a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-quobyte-1100a988-e4e5-4164-8971-2c9695c4d688" released by "delete_volume" :: held 0.746s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Created reservations ['60efa697-096f-4f8f-a102-531314cda9e4', 'a1377067-78ff-4655-b57c-c91986771a24', '794f05ad-fea4-4eda-9330-63b1493f8f9a', 'b78147cf-3009-44f2-b072-5eb0ddf6067c'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:22 devstack sudo[108807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af
Sep 29 18:36:22 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:22 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:22 devstack sudo[108809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:36:22 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:23 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af" returned: 0 in 0.377s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:23 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6dd2092-850d-4252-a4ea-96ed0237c504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:36:23 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7a9fb8-4517-4fd5-8188-ff04780d6ca8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:23 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.286s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:23 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:36:23 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Deleted volume successfully.
Sep 29 18:36:23 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-79f3c153-47db-4082-ab02-bd40ff2362a0 tempest-ProjectReaderTests-1134823584 None] Lock "cinder-1100a988-e4e5-4164-8971-2c9695c4d688-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:23 devstack sudo[108816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504
Sep 29 18:36:23 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:23 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504" returned: 0 in 0.387s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:23 devstack sudo[108821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af
Sep 29 18:36:23 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:23 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af" returned: 0 in 0.337s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:23 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:23 devstack sudo[108826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af
Sep 29 18:36:23 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:24 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:24 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504.fd3ca322-4590-4527-8455-444b3c2982af" returned: 0 in 0.273s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-fd3ca322-4590-4527-8455-444b3c2982af" released by "_delete_snapshot" :: held 1.498s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b6dd2092-850d-4252-a4ea-96ed0237c504" released by "delete_snapshot" :: held 1.520s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:24 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Created reservations ['e02e61f5-32fd-4852-ba33-65eb52f73a1e', 'dd6c7b23-74f4-4722-a285-d60b8a122527', 'bc0cf9eb-f9c3-4991-a923-abe4f45b47ac', '09f7ae26-abe9-4a9d-bcfc-9cf88e60cea6'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:24 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Delete snapshot completed successfully.
Sep 29 18:36:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-a77e17f7-aff6-401d-8763-58e946c83aa8 tempest-ProjectMemberTests-918657444 None] Lock "cinder-fd3ca322-4590-4527-8455-444b3c2982af-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-b6dd2092-850d-4252-a4ea-96ed0237c504-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Lock "cinder-b6dd2092-850d-4252-a4ea-96ed0237c504-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-b6dd2092-850d-4252-a4ea-96ed0237c504" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:24 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b6dd2092-850d-4252-a4ea-96ed0237c504" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb47f30-570b-4279-bf5e-0d299f939130]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:25 devstack sudo[108829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504
Sep 29 18:36:25 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:25 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504" returned: 0 in 0.388s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:25 devstack sudo[108834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504
Sep 29 18:36:25 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:25 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-b6dd2092-850d-4252-a4ea-96ed0237c504" returned: 0 in 0.249s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-b6dd2092-850d-4252-a4ea-96ed0237c504" released by "delete_volume" :: held 0.709s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Created reservations ['d51b5bb3-b891-44a2-bd48-3276138a7c74', '14470d8f-abdf-41ad-910a-e20b7fa83efc', '477e76c8-2adf-44d6-ac51-99563b243c95', 'a0491fa0-e0bd-42cc-af14-faec02b03e50'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:25 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:25 devstack sudo[108837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:36:25 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:26 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.263s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:36:26 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Deleted volume successfully.
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-bcc1687b-6918-4710-b4f1-727b44122262 tempest-ProjectMemberTests-918657444 None] Lock "cinder-b6dd2092-850d-4252-a4ea-96ed0237c504-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (c3aad864-b40e-4533-9e93-afc820e21a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2b651a-99da-4e4e-baca-32d51274450a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2b651a-99da-4e4e-baca-32d51274450a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677169147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11d4308-325b-4533-96de-65a2c0fd0250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:26Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe48dde-3fea-4b91-8b09-b760e3b0a118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe48dde-3fea-4b91-8b09-b760e3b0a118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9734e84-ad87-496b-a5b3-6a37f3b1a97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9734e84-ad87-496b-a5b3-6a37f3b1a97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11d4308-325b-4533-96de-65a2c0fd0250', 'volume_name': 'volume-e11d4308-325b-4533-96de-65a2c0fd0250', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b6d847-4d35-477f-b58c-28f692d7f584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b6d847-4d35-477f-b58c-28f692d7f584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475f9ea6-5830-4605-8363-f5f58b484076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:26 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Volume e11d4308-325b-4533-96de-65a2c0fd0250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11d4308-325b-4533-96de-65a2c0fd0250', 'volume_size': 1}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677169147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11d4308-325b-4533-96de-65a2c0fd0250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b151a16cd45d49c8aff1d9a7eb110c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:26Z,use_quota=True,user_id='5dc1b68407cd49aa97d91155447fdcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Creating volume e11d4308-325b-4533-96de-65a2c0fd0250 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:36:26 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:36:26 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:26 devstack sudo[108840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250 1073741824
Sep 29 18:36:26 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:27 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250 1073741824" returned: 0 in 0.462s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:27 devstack sudo[108846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250
Sep 29 18:36:27 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:27 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250" returned: 0 in 0.269s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:27 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:36:27 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475f9ea6-5830-4605-8363-f5f58b484076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11d4308-325b-4533-96de-65a2c0fd0250', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612f4105-d65c-4d40-b264-700d92eb42d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:27 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Volume volume-e11d4308-325b-4533-96de-65a2c0fd0250 (e11d4308-325b-4533-96de-65a2c0fd0250): created successfully
Sep 29 18:36:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612f4105-d65c-4d40-b264-700d92eb42d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:27 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Flow 'volume_create_manager' (c3aad864-b40e-4533-9e93-afc820e21a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:27 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8383fc8e-7fa4-4ffc-a32d-8d1b9c5d204f tempest-ProjectMemberTests-918657444 None] Created volume successfully.
Sep 29 18:36:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:28 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] Creating offline snapshot 5c565446-5868-401f-b98d-76ec2a78bdb7 of volume e11d4308-325b-4533-96de-65a2c0fd0250 {{(pid=86821) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 29 18:36:28 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb090f7-7473-4806-966a-2b60dbec677c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:28 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:28 devstack sudo[108849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250
Sep 29 18:36:28 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:29 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250" returned: 0 in 0.372s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7 1G {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:29 devstack sudo[108854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7 1G
Sep 29 18:36:29 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:29 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7 1G" returned: 0 in 0.459s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11d4308-325b-4533-96de-65a2c0fd0250 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:29 devstack sudo[108860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11d4308-325b-4533-96de-65a2c0fd0250 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7
Sep 29 18:36:29 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:29 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11d4308-325b-4533-96de-65a2c0fd0250 -F qcow2 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7" returned: 0 in 0.319s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:29 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7 is being set with open permissions: ugo+rw
Sep 29 18:36:29 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:30 devstack sudo[108865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7
Sep 29 18:36:30 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:30 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7" returned: 0 in 0.247s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:30 devstack sudo[108868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.info
Sep 29 18:36:30 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:30 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.info" returned: 0 in 0.249s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:30 devstack cinder-volume[86821]: WARNING cinder.volume.drivers.remotefs [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.info is being set with open permissions: ugo+rw
Sep 29 18:36:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.info {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:30 devstack sudo[108871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.info
Sep 29 18:36:30 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:30 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.info" returned: 0 in 0.260s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:30 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:30 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-ed3e071f-978d-4745-8617-7c1de2ba86e9 tempest-ProjectMemberTests-918657444 None] Create snapshot completed successfully
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-5c565446-5868-401f-b98d-76ec2a78bdb7-delete_snapshot" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Lock "cinder-5c565446-5868-401f-b98d-76ec2a78bdb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-e11d4308-325b-4533-96de-65a2c0fd0250" by "delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-e11d4308-325b-4533-96de-65a2c0fd0250" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-5c565446-5868-401f-b98d-76ec2a78bdb7" by "_delete_snapshot" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-5c565446-5868-401f-b98d-76ec2a78bdb7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Deleting offline snapshot 5c565446-5868-401f-b98d-76ec2a78bdb7 of volume e11d4308-325b-4533-96de-65a2c0fd0250 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] snapshot_file for this snap is: volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7 {{(pid=86821) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae4ca3b-b91e-429a-b0f7-361e45b15189]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:31 devstack sudo[108908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7
Sep 29 18:36:31 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:31 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7" returned: 0 in 0.392s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11d4308-325b-4533-96de-65a2c0fd0250(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86821) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6854895a-032a-4258-8256-80a46bab64eb]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:31 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:31 devstack sudo[108921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250
Sep 29 18:36:31 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:32 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250" returned: 0 in 0.392s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:32 devstack sudo[108927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7
Sep 29 18:36:32 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:32 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7" returned: 0 in 0.376s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:32 devstack sudo[108932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7
Sep 29 18:36:32 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:32 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:32 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250.5c565446-5868-401f-b98d-76ec2a78bdb7" returned: 0 in 0.267s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-5c565446-5868-401f-b98d-76ec2a78bdb7" released by "_delete_snapshot" :: held 1.571s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-e11d4308-325b-4533-96de-65a2c0fd0250" released by "delete_snapshot" :: held 1.606s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:32 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Created reservations ['f9227e8f-b332-44ca-b5a2-6b1a4f980afe', 'c1b8e5ce-ac53-4706-94e4-82ff99067256', '11949d00-9bd9-42b5-bc0f-d1239e6639ab', '6fd3c494-ee09-4f72-8ab5-3a2d1d22bf0b'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:32 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Delete snapshot completed successfully.
Sep 29 18:36:32 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-3ecc4d99-29fd-43fd-b1ee-e9c41ace9715 tempest-ProjectMemberTests-918657444 None] Lock "cinder-5c565446-5868-401f-b98d-76ec2a78bdb7-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-e11d4308-325b-4533-96de-65a2c0fd0250-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Lock "cinder-e11d4308-325b-4533-96de-65a2c0fd0250-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Acquiring lock "cinder-quobyte-e11d4308-325b-4533-96de-65a2c0fd0250" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:33 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-e11d4308-325b-4533-96de-65a2c0fd0250" acquired by "delete_volume" :: waited 0.019s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:33 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c93ac72-8861-4b0d-b0b3-15e138931ce0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:33 devstack sudo[108936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250
Sep 29 18:36:33 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:33 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250" returned: 0 in 0.409s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:33 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:33 devstack sudo[108941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250
Sep 29 18:36:33 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:34 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-e11d4308-325b-4533-96de-65a2c0fd0250" returned: 0 in 0.300s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Lock "cinder-quobyte-e11d4308-325b-4533-96de-65a2c0fd0250" released by "delete_volume" :: held 0.792s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Created reservations ['d34a4d10-2856-452e-be21-bf7aa2940200', 'cb087e46-96a5-40f8-a956-f46764649f20', '24598444-5a6a-42ed-a09e-316ca98533e1', '8d896a6e-eff3-47a5-a271-17025f5762a0'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:34 devstack sudo[108944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:36:34 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:34 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.256s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:36:34 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Deleted volume successfully.
Sep 29 18:36:34 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-6c3c12ed-4fb4-4f76-938b-f061fdc4cbed tempest-ProjectMemberTests-918657444 None] Lock "cinder-e11d4308-325b-4533-96de-65a2c0fd0250-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:44 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=27,cinder:DELETE=3,cinder:INSERT=9,cinder:UPDATE=37 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:36:44 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=32,cinder:INSERT=14,cinder:UPDATE=43,cinder:DELETE=3 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:54 devstack sudo[108950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:36:54 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:54 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.258s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG oslo_service.periodic_task [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] Running periodic task VolumeManager._thread_info {{(pid=86821) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread count: 28 {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 29 18:36:54 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-061a691c-7fe8-4439-b11b-c27850bd7953 None None] thread info: [<_MainThread(MainThread, started 132266167869568)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132266057557248)>, <Thread(Thread-3 (stat_writer), started daemon 132266052823680)>, <Thread(Rabbit-heartbeat, started daemon 132266053118464)>, <Thread(Thread-5 (_runner), started daemon 132266051670016)>, <Thread(Thread-7 (_runner), started daemon 132266051800960)>, <Thread(fd_logger, started daemon 132266049591744)>, <Thread(privsep_reader, started daemon 132266049819136)>, <Thread(tpool_thread_0, started daemon 132266040948416)>, <Thread(tpool_thread_1, started daemon 132266032555712)>, <Thread(tpool_thread_2, started daemon 132266024163008)>, <Thread(tpool_thread_3, started daemon 132266015770304)>, <Thread(tpool_thread_4, started daemon 132266007377600)>, <Thread(tpool_thread_5, started daemon 132265998984896)>, <Thread(tpool_thread_6, started daemon 132265990575808)>, <Thread(tpool_thread_7, started daemon 132265982166720)>, <Thread(tpool_thread_8, started daemon 132265973757632)>, <Thread(tpool_thread_9, started daemon 132265965348544)>, <Thread(tpool_thread_10, started daemon 132265956939456)>, <Thread(tpool_thread_11, started daemon 132265948530368)>, <Thread(tpool_thread_12, started daemon 132265940121280)>, <Thread(tpool_thread_13, started daemon 132265931712192)>, <Thread(tpool_thread_14, started daemon 132265923303104)>, <Thread(tpool_thread_15, started daemon 132265914894016)>, <Thread(tpool_thread_16, started daemon 132265906484928)>, <Thread(tpool_thread_17, started daemon 132265898075840)>, <Thread(tpool_thread_18, started daemon 132265889666752)>, <Thread(tpool_thread_19, started daemon 132265881257664)>] {{(pid=86821) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Flow 'volume_create_manager' (ca46b3ac-f53f-4646-b38e-5dbddfddaf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd694d3-d358-4bd4-ab58-55ceb89b1d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd694d3-d358-4bd4-ab58-55ceb89b1d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1131830544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14394489-9a02-4f7a-a522-dba1afc9f04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0df73ecf996483b83d4915cc903a144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:56Z,use_quota=True,user_id='143f1c4c5e9347c5aa8d9424a957ec26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4880886-dd64-4979-9903-9dfa1addf845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4880886-dd64-4979-9903-9dfa1addf845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b7f59d-429b-44b9-b607-471a247dd3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b7f59d-429b-44b9-b607-471a247dd3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14394489-9a02-4f7a-a522-dba1afc9f04b', 'volume_name': 'volume-14394489-9a02-4f7a-a522-dba1afc9f04b', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759ea33d-01bd-48f0-b4df-c8bb0f183c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759ea33d-01bd-48f0-b4df-c8bb0f183c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a18fe3-c623-461d-aef6-3a4869466d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:56 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Volume 14394489-9a02-4f7a-a522-dba1afc9f04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14394489-9a02-4f7a-a522-dba1afc9f04b', 'volume_size': 1}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1131830544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14394489-9a02-4f7a-a522-dba1afc9f04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0df73ecf996483b83d4915cc903a144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:56Z,use_quota=True,user_id='143f1c4c5e9347c5aa8d9424a957ec26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Creating volume 14394489-9a02-4f7a-a522-dba1afc9f04b {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:36:56 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:36:56 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:56 devstack sudo[108953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b 1073741824
Sep 29 18:36:56 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:57 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b 1073741824" returned: 0 in 0.414s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:57 devstack sudo[108958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b
Sep 29 18:36:57 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:57 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b" returned: 0 in 0.233s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a18fe3-c623-461d-aef6-3a4869466d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14394489-9a02-4f7a-a522-dba1afc9f04b', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784882bc-c93e-41cf-8b5a-c31dd215864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:57 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Volume volume-14394489-9a02-4f7a-a522-dba1afc9f04b (14394489-9a02-4f7a-a522-dba1afc9f04b): created successfully
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784882bc-c93e-41cf-8b5a-c31dd215864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Flow 'volume_create_manager' (ca46b3ac-f53f-4646-b38e-5dbddfddaf13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:57 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-373d982d-2df2-4968-8325-87dda61c94fe tempest-ProjectReaderTests-1966436780 None] Created volume successfully.
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Acquiring lock "cinder-14394489-9a02-4f7a-a522-dba1afc9f04b-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Lock "cinder-14394489-9a02-4f7a-a522-dba1afc9f04b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Acquiring lock "cinder-quobyte-14394489-9a02-4f7a-a522-dba1afc9f04b" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Lock "cinder-quobyte-14394489-9a02-4f7a-a522-dba1afc9f04b" acquired by "delete_volume" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffba41a-ca27-49f1-aa0a-7e631d9d2dfd]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:36:57 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:57 devstack sudo[108961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b
Sep 29 18:36:57 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:58 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b" returned: 0 in 0.341s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:58 devstack sudo[108966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b
Sep 29 18:36:58 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:58 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-14394489-9a02-4f7a-a522-dba1afc9f04b" returned: 0 in 0.237s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Lock "cinder-quobyte-14394489-9a02-4f7a-a522-dba1afc9f04b" released by "delete_volume" :: held 0.619s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Created reservations ['5bfee5c9-65ef-475a-8739-38ba6464d378', 'a13b5e5f-b106-4c7f-bbac-b0959e562067', '5a9b1785-79a7-49f0-bcbb-6265c03ebe7b', '02acce74-ae98-4189-a2e4-e863ee7db8c2'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:58 devstack sudo[108969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:36:58 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:58 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.249s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:36:58 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Deleted volume successfully.
Sep 29 18:36:58 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-1d3b2dad-f945-4e4b-989e-2924a5c7456d tempest-ProjectReaderTests-1966436780 None] Lock "cinder-14394489-9a02-4f7a-a522-dba1afc9f04b-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Flow 'volume_create_manager' (601ed51d-7297-4e59-af69-fb5c2f8a6479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d22f68-2f04-4210-85a7-8c45e55d8620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d22f68-2f04-4210-85a7-8c45e55d8620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1237061020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c09a35-ad25-45f3-9951-c3594472a403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0df73ecf996483b83d4915cc903a144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:59Z,use_quota=True,user_id='143f1c4c5e9347c5aa8d9424a957ec26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40720f2f-3808-4ded-9221-0ba59a2789f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40720f2f-3808-4ded-9221-0ba59a2789f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8344151f-b517-4ace-bae6-845f4aeed374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8344151f-b517-4ace-bae6-845f4aeed374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c09a35-ad25-45f3-9951-c3594472a403', 'volume_name': 'volume-a8c09a35-ad25-45f3-9951-c3594472a403', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab01197-7df2-45cf-a9e6-34f3c99da303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab01197-7df2-45cf-a9e6-34f3c99da303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fafa077-63c6-4b39-abf7-31e035d8a1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:36:59 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Volume a8c09a35-ad25-45f3-9951-c3594472a403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c09a35-ad25-45f3-9951-c3594472a403', 'volume_size': 1}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1237061020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c09a35-ad25-45f3-9951-c3594472a403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0df73ecf996483b83d4915cc903a144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:59Z,use_quota=True,user_id='143f1c4c5e9347c5aa8d9424a957ec26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Creating volume a8c09a35-ad25-45f3-9951-c3594472a403 {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:36:59 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:59 devstack sudo[108972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403 1073741824
Sep 29 18:36:59 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:36:59 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403 1073741824" returned: 0 in 0.414s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:36:59 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:36:59 devstack sudo[108978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403
Sep 29 18:36:59 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:00 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403" returned: 0 in 0.241s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fafa077-63c6-4b39-abf7-31e035d8a1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c09a35-ad25-45f3-9951-c3594472a403', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9280c007-5387-49f9-a962-155254abd308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:00 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Volume volume-a8c09a35-ad25-45f3-9951-c3594472a403 (a8c09a35-ad25-45f3-9951-c3594472a403): created successfully
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9280c007-5387-49f9-a962-155254abd308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Flow 'volume_create_manager' (601ed51d-7297-4e59-af69-fb5c2f8a6479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:37:00 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-6ebd1ee0-f51b-4714-927d-bd5127a6978f tempest-ProjectReaderTests-1966436780 None] Created volume successfully.
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Acquiring lock "cinder-a8c09a35-ad25-45f3-9951-c3594472a403-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Lock "cinder-a8c09a35-ad25-45f3-9951-c3594472a403-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Acquiring lock "cinder-quobyte-a8c09a35-ad25-45f3-9951-c3594472a403" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Lock "cinder-quobyte-a8c09a35-ad25-45f3-9951-c3594472a403" acquired by "delete_volume" :: waited 0.016s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[65281b26-d5c7-4100-af20-6e9d4ecd51d7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:00 devstack sudo[108981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403
Sep 29 18:37:00 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:00 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403" returned: 0 in 0.362s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:00 devstack sudo[108986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403
Sep 29 18:37:00 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:00 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:00 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-a8c09a35-ad25-45f3-9951-c3594472a403" returned: 0 in 0.245s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Lock "cinder-quobyte-a8c09a35-ad25-45f3-9951-c3594472a403" released by "delete_volume" :: held 0.650s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Created reservations ['cc520428-7e03-4bef-b191-028088db09fa', 'bbe10cf7-d027-4558-9971-4ec6e2a6c89f', '2dc5deb5-046c-4277-a1d3-6bfd66a0b6b4', '274875c0-4464-48d5-b611-0c304998c217'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:01 devstack sudo[108989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:37:01 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:01 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.250s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:37:01 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Deleted volume successfully.
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-0618518c-7ff6-497e-81d8-11073d518a0c tempest-ProjectReaderTests-1966436780 None] Lock "cinder-a8c09a35-ad25-45f3-9951-c3594472a403-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Flow 'volume_create_manager' (4493c2c9-800d-43df-8d48-98c2415b4608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ede5180-f165-421a-91c1-0a3dd940f823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ede5180-f165-421a-91c1-0a3dd940f823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289619992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f77adf-6fd6-48eb-a6d8-fb7a055079de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0df73ecf996483b83d4915cc903a144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:02Z,use_quota=True,user_id='143f1c4c5e9347c5aa8d9424a957ec26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f95906-a598-4bea-92e8-bfee2876a346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f95906-a598-4bea-92e8-bfee2876a346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc309526-6324-4747-8906-67d8132b16a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc309526-6324-4747-8906-67d8132b16a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f77adf-6fd6-48eb-a6d8-fb7a055079de', 'volume_name': 'volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65d7e21-1152-4e06-a6ae-39caa4090eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65d7e21-1152-4e06-a6ae-39caa4090eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0993b7f-321d-4d0d-b109-86abfd804124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:01 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Volume 21f77adf-6fd6-48eb-a6d8-fb7a055079de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de', 'volume_size': 1}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289619992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f77adf-6fd6-48eb-a6d8-fb7a055079de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0df73ecf996483b83d4915cc903a144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:02Z,use_quota=True,user_id='143f1c4c5e9347c5aa8d9424a957ec26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Creating volume 21f77adf-6fd6-48eb-a6d8-fb7a055079de {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:37:01 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:37:01 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:01 devstack sudo[108992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de 1073741824
Sep 29 18:37:01 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:02 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de 1073741824" returned: 0 in 0.411s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:02 devstack sudo[108997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de
Sep 29 18:37:02 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:02 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de" returned: 0 in 0.242s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0993b7f-321d-4d0d-b109-86abfd804124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c6abe9-933a-43e2-b5e7-441952df3ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:02 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Volume volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de (21f77adf-6fd6-48eb-a6d8-fb7a055079de): created successfully
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c6abe9-933a-43e2-b5e7-441952df3ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Flow 'volume_create_manager' (4493c2c9-800d-43df-8d48-98c2415b4608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:37:02 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2595e7a7-4b36-487c-ac75-6f06aeff96c1 tempest-ProjectReaderTests-1966436780 None] Created volume successfully.
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Acquiring lock "cinder-21f77adf-6fd6-48eb-a6d8-fb7a055079de-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Lock "cinder-21f77adf-6fd6-48eb-a6d8-fb7a055079de-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:37:02 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Acquiring lock "cinder-quobyte-21f77adf-6fd6-48eb-a6d8-fb7a055079de" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Lock "cinder-quobyte-21f77adf-6fd6-48eb-a6d8-fb7a055079de" acquired by "delete_volume" :: waited 0.013s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2404261e-4eba-45fe-81aa-5bb748d6b9db]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:03 devstack sudo[109000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de
Sep 29 18:37:03 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:03 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de" returned: 0 in 0.348s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:03 devstack sudo[109006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de
Sep 29 18:37:03 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:03 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-21f77adf-6fd6-48eb-a6d8-fb7a055079de" returned: 0 in 0.259s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Lock "cinder-quobyte-21f77adf-6fd6-48eb-a6d8-fb7a055079de" released by "delete_volume" :: held 0.650s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Created reservations ['1e707778-8f52-4ebe-8780-94033745de99', '87352261-8f29-44af-99c0-89b3cd762adf', '3d489c7a-0fc6-42e4-83ed-11440b3d43e8', 'cd429ef4-cf3f-4277-a342-c82a95b3e7d8'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:37:03 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:03 devstack sudo[109009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:37:03 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:04 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.250s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:37:04 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Deleted volume successfully.
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-2f654ae8-682b-47ee-be3f-cbe26ea4b698 tempest-ProjectReaderTests-1966436780 None] Lock "cinder-21f77adf-6fd6-48eb-a6d8-fb7a055079de-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.flows.manager.create_volume [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86821) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Flow 'volume_create_manager' (247c3240-f34e-42cf-a523-9d87b753a5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cf3d87-71d7-418b-a32c-cf55ab192f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cf3d87-71d7-418b-a32c-cf55ab192f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629008164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7e4a8d-fe92-48ae-8d6c-457908687bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0df73ecf996483b83d4915cc903a144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:04Z,use_quota=True,user_id='143f1c4c5e9347c5aa8d9424a957ec26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9214045c-7964-4e23-8fce-f130dd0d91d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9214045c-7964-4e23-8fce-f130dd0d91d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9986f483-bc74-48b9-b632-290b89010bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9986f483-bc74-48b9-b632-290b89010bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab7e4a8d-fe92-48ae-8d6c-457908687bea', 'volume_name': 'volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d66d2c-7f03-43a1-bbd7-8a8b63bfe496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d66d2c-7f03-43a1-bbd7-8a8b63bfe496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3a39be-43ba-4624-8b4c-82313b5eb2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:04 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Volume ab7e4a8d-fe92-48ae-8d6c-457908687bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea', 'volume_size': 1}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x784b97728aa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-29T16:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629008164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7e4a8d-fe92-48ae-8d6c-457908687bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0df73ecf996483b83d4915cc903a144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:04Z,use_quota=True,user_id='143f1c4c5e9347c5aa8d9424a957ec26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63a5f63d-b492-4695-81ab-147aedf14494),volume_type_id=63a5f63d-b492-4695-81ab-147aedf14494)}" {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.remotefs [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Creating volume ab7e4a8d-fe92-48ae-8d6c-457908687bea {{(pid=86821) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Selected osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87 as target Quobyte volume. {{(pid=86821) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 29 18:37:04 devstack cinder-volume[86821]: INFO cinder.volume.drivers.remotefs [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] casted to osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87
Sep 29 18:37:04 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea 1073741824 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:04 devstack sudo[109013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea 1073741824
Sep 29 18:37:04 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:05 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea 1073741824" returned: 0 in 0.398s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:05 devstack sudo[109018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea
Sep 29 18:37:05 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:05 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea" returned: 0 in 0.232s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'} {{(pid=86821) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3a39be-43ba-4624-8b4c-82313b5eb2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea', 'volume_size': 1}' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e66d2e-105f-49b1-8cc0-bccbca11908a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 29 18:37:05 devstack cinder-volume[86821]: INFO cinder.volume.flows.manager.create_volume [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Volume volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea (ab7e4a8d-fe92-48ae-8d6c-457908687bea): created successfully
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e66d2e-105f-49b1-8cc0-bccbca11908a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86821) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Flow 'volume_create_manager' (247c3240-f34e-42cf-a523-9d87b753a5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86821) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 29 18:37:05 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-67430e65-d165-49eb-b630-0a10473ee208 tempest-ProjectReaderTests-1966436780 None] Created volume successfully.
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Acquiring lock "cinder-ab7e4a8d-fe92-48ae-8d6c-457908687bea-delete_volume" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Lock "cinder-ab7e4a8d-fe92-48ae-8d6c-457908687bea-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Acquiring lock "cinder-quobyte-ab7e4a8d-fe92-48ae-8d6c-457908687bea" by "delete_volume" {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Lock "cinder-quobyte-ab7e4a8d-fe92-48ae-8d6c-457908687bea" acquired by "delete_volume" :: waited 0.013s {{(pid=86821) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG oslo.privsep.daemon [-] privsep: reply[556cd55b-4493-4741-90cd-c71f344a3b31]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 29 18:37:05 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:05 devstack sudo[109021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea
Sep 29 18:37:05 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:06 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea" returned: 0 in 0.353s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:06 devstack sudo[109026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea
Sep 29 18:37:06 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:06 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09/volume-ab7e4a8d-fe92-48ae-8d6c-457908687bea" returned: 0 in 0.237s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Lock "cinder-quobyte-ab7e4a8d-fe92-48ae-8d6c-457908687bea" released by "delete_volume" :: held 0.631s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG cinder.quota [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Created reservations ['5abadaa6-9efd-4c67-8cb1-9edbe0892872', '0efc1690-daa4-4b1e-9721-d4bea37beb46', '61bfff82-a29e-420d-9c4b-93b11ddd325e', '2c73e46c-36e3-4f45-8002-ce5aac559499'] {{(pid=86821) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87': None} {{(pid=86821) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG cinder.volume.drivers.quobyte [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba9e6960-0e44-4380-a89f-13b7d9c9bb87'] {{(pid=86821) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.lockutils [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86821) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09 {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 29 18:37:06 devstack sudo[109029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09
Sep 29 18:37:06 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 29 18:37:06 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG oslo_concurrency.processutils [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8804605002ed6bbfbbc18d5e29a02b09" returned: 0 in 0.246s {{(pid=86821) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG cinder.manager [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Notifying Schedulers of capabilities ... {{(pid=86821) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 29 18:37:06 devstack cinder-volume[86821]: INFO cinder.volume.manager [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Deleted volume successfully.
Sep 29 18:37:06 devstack cinder-volume[86821]: DEBUG cinder.coordination [None req-8493001f-413a-4a6e-a818-2bcd575db0f0 tempest-ProjectReaderTests-1966436780 None] Lock "cinder-ab7e4a8d-fe92-48ae-8d6c-457908687bea-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86821) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 29 18:37:16 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:UPDATE=50,cinder:SELECT=27,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 29 18:37:16 devstack cinder-volume[86821]: DEBUG dbcounter [-] [86821] Writing DB stats cinder:SELECT=29,cinder:UPDATE=38,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86821) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}